2026-02-21T01:23:10.830 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T01:23:10.847 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T01:23:10.925 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184 branch: wip-yuri3-testing-2026-02-19-1610-tentacle description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{bitmap} base mem$/{normal-1} onode-segment$/{none} write$/{v1/{compr$/{no$/{no}} v1}}}} rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/rados_api_tests} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '62184' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri3-testing-2026-02-19-1610-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 global: debug ms: 1 debug objecter: 20 debug rados: 20 mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 mon warn on pool no app: false paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2: false bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_FULL\) - \(SLOW_OPS\) - \(MON_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - slow request mon_bind_msgr2: false sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2026-02-19-1610-tentacle sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 6877 sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri3-testing-2026-02-19-1610-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 targets: trial043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpJi8jW38DMMWNnEOuvQXC/7cdtrsuEQsyDXnbh4esuQOnrYFzh1zGrUlP14G9pDYZysX2kiRRsaOvQIUsV63c= trial046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ0b32S60LaKjrmPn6Exx1tXYKLq6tl0nZqauEW/yF+aTjwpCk3Ye4D2hXz5nGcVsNXtA45MpbV0toiGhwgoXZM= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 thrash_many: true - workunit: clients: client.0: - rados/test.sh unit_test_scan teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-21_00:21:18 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-21T01:23:10.926 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa; will attempt to use it 2026-02-21T01:23:10.926 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa/tasks 2026-02-21T01:23:10.926 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-21T01:23:10.928 INFO:teuthology.task.internal:Checking packages... 2026-02-21T01:23:10.928 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '36d388f27052dd940bdbaf543bb05bdba0acc155' 2026-02-21T01:23:10.928 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-21T01:23:10.928 INFO:teuthology.packaging:ref: None 2026-02-21T01:23:10.928 INFO:teuthology.packaging:tag: None 2026-02-21T01:23:10.928 INFO:teuthology.packaging:branch: wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-21T01:23:10.928 INFO:teuthology.packaging:sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-21T01:23:10.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-21T01:23:11.047 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-681.g36d388f2 2026-02-21T01:23:11.049 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-21T01:23:11.065 INFO:teuthology.task.internal:no buildpackages task found 2026-02-21T01:23:11.065 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-21T01:23:11.078 INFO:teuthology.task.internal:Saving configuration 2026-02-21T01:23:11.087 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-21T01:23:11.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-21T01:23:11.174 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial043.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-21 01:19:37.348433', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpJi8jW38DMMWNnEOuvQXC/7cdtrsuEQsyDXnbh4esuQOnrYFzh1zGrUlP14G9pDYZysX2kiRRsaOvQIUsV63c='} 2026-02-21T01:23:11.246 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial046.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-21 01:19:37.349028', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ0b32S60LaKjrmPn6Exx1tXYKLq6tl0nZqauEW/yF+aTjwpCk3Ye4D2hXz5nGcVsNXtA45MpbV0toiGhwgoXZM='} 2026-02-21T01:23:11.247 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-21T01:23:11.258 INFO:teuthology.task.internal:roles: ubuntu@trial043.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-21T01:23:11.258 INFO:teuthology.task.internal:roles: ubuntu@trial046.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-21T01:23:11.258 INFO:teuthology.run_tasks:Running task console_log... 2026-02-21T01:23:11.392 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbb38c24400>, signals=[15]) 2026-02-21T01:23:11.392 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-21T01:23:11.438 INFO:teuthology.task.internal:Opening connections... 2026-02-21T01:23:11.438 DEBUG:teuthology.task.internal:connecting to ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:23:11.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T01:23:11.503 DEBUG:teuthology.task.internal:connecting to ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:23:11.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T01:23:11.563 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-21T01:23:11.575 DEBUG:teuthology.orchestra.run.trial043:> uname -m 2026-02-21T01:23:11.590 INFO:teuthology.orchestra.run.trial043.stdout:x86_64 2026-02-21T01:23:11.591 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T01:23:11.646 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T01:23:11.647 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server 2026-02-21T01:23:11.720 DEBUG:teuthology.orchestra.run.trial046:> uname -m 2026-02-21T01:23:11.735 INFO:teuthology.orchestra.run.trial046.stdout:x86_64 2026-02-21T01:23:11.735 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:NAME="CentOS Stream" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="9" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:ID="centos" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel fedora" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="9" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el9" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;31" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://centos.org/" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-21T01:23:11.791 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-21T01:23:11.791 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server 2026-02-21T01:23:11.863 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-21T01:23:11.876 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-21T01:23:11.893 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-21T01:23:11.893 DEBUG:teuthology.orchestra.run.trial043:> test '!' -e /home/ubuntu/cephtest 2026-02-21T01:23:11.895 DEBUG:teuthology.orchestra.run.trial046:> test '!' -e /home/ubuntu/cephtest 2026-02-21T01:23:11.910 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-21T01:23:11.921 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-21T01:23:11.921 DEBUG:teuthology.orchestra.run.trial043:> test -z $(ls -A /var/lib/ceph) 2026-02-21T01:23:11.951 DEBUG:teuthology.orchestra.run.trial046:> test -z $(ls -A /var/lib/ceph) 2026-02-21T01:23:11.968 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-21T01:23:12.127 INFO:teuthology.run_tasks:Running task kernel... 2026-02-21T01:23:12.146 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-21T01:23:12.147 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-21T01:23:12.147 DEBUG:teuthology.orchestra.run.trial043:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-21T01:23:12.147 DEBUG:teuthology.orchestra.run.trial046:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-21T01:23:12.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:23:12.161 DEBUG:teuthology.orchestra.run.trial043:> uname -r 2026-02-21T01:23:12.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:23:12.162 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-21T01:23:12.216 INFO:teuthology.orchestra.run.trial043.stdout:5.14.0-681.el9.x86_64 2026-02-21T01:23:12.216 INFO:teuthology.task.kernel:Running kernel on trial043: 5.14.0-681.el9.x86_64 2026-02-21T01:23:12.216 DEBUG:teuthology.orchestra.run.trial043:> sudo yum install -y kernel 2026-02-21T01:23:12.218 INFO:teuthology.orchestra.run.trial046.stdout:5.14.0-681.el9.x86_64 2026-02-21T01:23:12.218 INFO:teuthology.task.kernel:Running kernel on trial046: 5.14.0-681.el9.x86_64 2026-02-21T01:23:12.218 DEBUG:teuthology.orchestra.run.trial046:> sudo yum install -y kernel 2026-02-21T01:23:13.265 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-21T01:23:13.270 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-21T01:23:14.489 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - AppStream 39 MB/s | 27 MB 00:00 2026-02-21T01:23:16.700 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 27 MB 00:02 2026-02-21T01:23:18.062 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 7.8 MB 00:01 2026-02-21T01:23:18.896 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - Extras packages 180 kB/s | 20 kB 00:00 2026-02-21T01:23:20.089 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-21T01:23:20.345 INFO:teuthology.orchestra.run.trial043.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-21T01:23:20.978 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - Extras packages 121 kB/s | 20 kB 00:00 2026-02-21T01:23:21.862 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-21T01:23:23.482 INFO:teuthology.orchestra.run.trial043.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-21T01:23:24.493 INFO:teuthology.orchestra.run.trial043.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-21T01:23:24.494 INFO:teuthology.orchestra.run.trial043.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-21T01:23:24.513 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:23:24.513 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:23:24.513 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:23:24.537 DEBUG:teuthology.orchestra.run.trial043:> echo no | sudo yum reinstall kernel || true 2026-02-21T01:23:24.879 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:01 ago on Sat 21 Feb 2026 01:23:23 AM UTC. 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:Reinstalling: 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 803 k 2026-02-21T01:23:24.961 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 0 2026-02-21T01:23:24.962 INFO:teuthology.orchestra.run.trial043.stderr:Operation aborted. 2026-02-21T01:23:24.982 INFO:teuthology.orchestra.run.trial043.stdout:Is this ok [y/N]: 2026-02-21T01:23:24.982 DEBUG:teuthology.orchestra.run.trial043:> sudo yum reinstall -y kernel || true 2026-02-21T01:23:25.009 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-21T01:23:25.283 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:02 ago on Sat 21 Feb 2026 01:23:23 AM UTC. 2026-02-21T01:23:25.362 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:Reinstalling: 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 803 k 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 0 2026-02-21T01:23:25.363 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:23:26.024 INFO:teuthology.orchestra.run.trial046.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-21T01:23:26.024 INFO:teuthology.orchestra.run.trial046.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-21T01:23:26.043 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:23:26.043 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:23:26.043 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:23:26.067 DEBUG:teuthology.orchestra.run.trial046:> echo no | sudo yum reinstall kernel || true 2026-02-21T01:23:26.367 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:01 ago on Sat 21 Feb 2026 01:23:25 AM UTC. 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalling: 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:23:26.448 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:23:26.449 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 803 k 2026-02-21T01:23:26.449 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 0 2026-02-21T01:23:26.449 INFO:teuthology.orchestra.run.trial046.stderr:Operation aborted. 2026-02-21T01:23:26.468 INFO:teuthology.orchestra.run.trial046.stdout:Is this ok [y/N]: 2026-02-21T01:23:26.469 DEBUG:teuthology.orchestra.run.trial046:> sudo yum reinstall -y kernel || true 2026-02-21T01:23:26.768 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:01 ago on Sat 21 Feb 2026 01:23:25 AM UTC. 2026-02-21T01:23:26.797 INFO:teuthology.orchestra.run.trial043.stdout:kernel-5.14.0-681.el9.x86_64.rpm 595 kB/s | 803 kB 00:01 2026-02-21T01:23:26.797 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:23:26.798 INFO:teuthology.orchestra.run.trial043.stdout:Total 560 kB/s | 803 kB 00:01 2026-02-21T01:23:26.808 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:23:26.841 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:23:26.841 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:23:26.846 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:23:26.846 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalling: 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:23:26.847 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:23:26.848 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 803 k 2026-02-21T01:23:26.848 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 0 2026-02-21T01:23:26.848 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:23:26.870 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:23:26.874 INFO:teuthology.orchestra.run.trial043.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-21T01:23:26.874 INFO:teuthology.orchestra.run.trial043.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T01:23:26.968 INFO:teuthology.orchestra.run.trial046.stdout:kernel-5.14.0-681.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2026-02-21T01:23:26.969 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:23:26.969 INFO:teuthology.orchestra.run.trial046.stdout:Total 6.5 MB/s | 803 kB 00:00 2026-02-21T01:23:26.979 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:23:26.982 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T01:23:26.982 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-21T01:23:27.013 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:23:27.013 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:23:27.017 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:23:27.017 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:23:27.038 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T01:23:27.038 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:23:27.039 INFO:teuthology.orchestra.run.trial043.stdout:Reinstalled: 2026-02-21T01:23:27.039 INFO:teuthology.orchestra.run.trial043.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-21T01:23:27.039 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:23:27.039 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:23:27.041 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:23:27.045 INFO:teuthology.orchestra.run.trial046.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-21T01:23:27.045 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T01:23:27.066 DEBUG:teuthology.orchestra.run.trial043:> rpm -q kernel | sort -rV | head -n 1 2026-02-21T01:23:27.092 INFO:teuthology.orchestra.run.trial043.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-21T01:23:27.093 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-21T01:23:27.093 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-21T01:23:27.093 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-21T01:23:27.093 DEBUG:teuthology.orchestra.run.trial043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-21T01:23:27.157 INFO:teuthology.orchestra.run.trial043.stdout:ttyS1 2026-02-21T01:23:27.157 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T01:23:27.157 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-21T01:23:27.178 DEBUG:teuthology.parallel:result is None 2026-02-21T01:23:27.209 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-21T01:23:27.209 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:23:27.209 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalled: 2026-02-21T01:23:27.210 INFO:teuthology.orchestra.run.trial046.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-21T01:23:27.210 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:23:27.210 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:23:27.238 DEBUG:teuthology.orchestra.run.trial046:> rpm -q kernel | sort -rV | head -n 1 2026-02-21T01:23:27.260 INFO:teuthology.orchestra.run.trial046.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-21T01:23:27.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-21T01:23:27.261 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-21T01:23:27.261 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-21T01:23:27.261 DEBUG:teuthology.orchestra.run.trial046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-21T01:23:27.325 INFO:teuthology.orchestra.run.trial046.stdout:ttyS1 2026-02-21T01:23:27.351 DEBUG:teuthology.parallel:result is None 2026-02-21T01:23:27.352 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-21T01:23:27.362 INFO:teuthology.task.internal:Creating test directory... 2026-02-21T01:23:27.363 DEBUG:teuthology.orchestra.run.trial043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-21T01:23:27.364 DEBUG:teuthology.orchestra.run.trial046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-21T01:23:27.408 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-21T01:23:27.418 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-21T01:23:27.430 INFO:teuthology.task.internal:Creating archive directory... 2026-02-21T01:23:27.430 DEBUG:teuthology.orchestra.run.trial043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-21T01:23:27.433 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-21T01:23:27.466 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-21T01:23:27.479 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-21T01:23:27.480 DEBUG:teuthology.orchestra.run.trial043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-21T01:23:27.489 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-21T01:23:27.512 INFO:teuthology.orchestra.run.trial043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T01:23:27.520 INFO:teuthology.orchestra.run.trial043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T01:23:27.527 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T01:23:27.536 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-21T01:23:27.537 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-21T01:23:27.548 INFO:teuthology.task.internal:Configuring sudo... 2026-02-21T01:23:27.548 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-21T01:23:27.564 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-21T01:23:27.602 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-21T01:23:27.619 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-21T01:23:27.620 DEBUG:teuthology.orchestra.run.trial043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-21T01:23:27.628 DEBUG:teuthology.orchestra.run.trial046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-21T01:23:27.657 DEBUG:teuthology.orchestra.run.trial043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T01:23:27.803 DEBUG:teuthology.orchestra.run.trial043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T01:23:27.827 DEBUG:teuthology.orchestra.run.trial043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T01:23:27.956 DEBUG:teuthology.orchestra.run.trial043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T01:23:27.979 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:23:27.979 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-21T01:23:28.042 DEBUG:teuthology.orchestra.run.trial046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T01:23:28.159 DEBUG:teuthology.orchestra.run.trial046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T01:23:28.183 DEBUG:teuthology.orchestra.run.trial046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T01:23:28.332 DEBUG:teuthology.orchestra.run.trial046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T01:23:28.355 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:23:28.355 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-21T01:23:28.418 DEBUG:teuthology.orchestra.run.trial043:> sudo service rsyslog restart 2026-02-21T01:23:28.420 DEBUG:teuthology.orchestra.run.trial046:> sudo service rsyslog restart 2026-02-21T01:23:28.446 INFO:teuthology.orchestra.run.trial043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-21T01:23:28.485 INFO:teuthology.orchestra.run.trial046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-21T01:23:28.968 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-21T01:23:28.981 INFO:teuthology.task.internal:Starting timer... 2026-02-21T01:23:28.982 INFO:teuthology.run_tasks:Running task pcp... 2026-02-21T01:23:29.004 INFO:teuthology.run_tasks:Running task selinux... 2026-02-21T01:23:29.032 DEBUG:teuthology.orchestra.run.trial043:> sudo service auditd rotate 2026-02-21T01:23:29.061 INFO:teuthology.orchestra.run.trial043.stdout:Rotating logs: 2026-02-21T01:23:29.062 DEBUG:teuthology.orchestra.run.trial046:> sudo service auditd rotate 2026-02-21T01:23:29.091 INFO:teuthology.orchestra.run.trial046.stdout:Rotating logs: 2026-02-21T01:23:29.092 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-21T01:23:29.093 DEBUG:teuthology.orchestra.run.trial043:> /usr/sbin/getenforce 2026-02-21T01:23:29.120 INFO:teuthology.orchestra.run.trial043.stdout:Permissive 2026-02-21T01:23:29.120 DEBUG:teuthology.orchestra.run.trial046:> /usr/sbin/getenforce 2026-02-21T01:23:29.148 INFO:teuthology.orchestra.run.trial046.stdout:Permissive 2026-02-21T01:23:29.149 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial043.front.sepia.ceph.com': 'permissive', 'ubuntu@trial046.front.sepia.ceph.com': 'permissive'} 2026-02-21T01:23:29.149 DEBUG:teuthology.orchestra.run.trial043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-21T01:23:29.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:23:29.185 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-21T01:23:29.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:23:29.212 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-21T01:23:29.212 DEBUG:teuthology.orchestra.run.trial043:> sudo /usr/sbin/setenforce permissive 2026-02-21T01:23:29.248 DEBUG:teuthology.orchestra.run.trial046:> sudo /usr/sbin/setenforce permissive 2026-02-21T01:23:29.275 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-21T01:23:29.287 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-21T01:23:29.295 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-21T01:23:29.296 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial043.front.sepia.ceph.com,trial046.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-21T01:26:12.480 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial043.front.sepia.ceph.com'), Remote(name='ubuntu@trial046.front.sepia.ceph.com')] 2026-02-21T01:26:12.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-21T01:26:12.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T01:26:12.564 DEBUG:teuthology.orchestra.run.trial043:> true 2026-02-21T01:26:12.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial043.front.sepia.ceph.com' 2026-02-21T01:26:12.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-21T01:26:12.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T01:26:12.733 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-21T01:26:12.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-21T01:26:12.809 INFO:teuthology.run_tasks:Running task clock... 2026-02-21T01:26:12.821 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-21T01:26:12.822 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-21T01:26:12.822 DEBUG:teuthology.orchestra.run.trial043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-21T01:26:12.824 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-21T01:26:12.824 DEBUG:teuthology.orchestra.run.trial046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-21T01:26:12.849 INFO:teuthology.orchestra.run.trial043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-21T01:26:12.861 INFO:teuthology.orchestra.run.trial043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-21T01:26:12.875 INFO:teuthology.orchestra.run.trial046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-21T01:26:12.880 INFO:teuthology.orchestra.run.trial043.stderr:sudo: ntpd: command not found 2026-02-21T01:26:12.886 INFO:teuthology.orchestra.run.trial046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-21T01:26:12.890 INFO:teuthology.orchestra.run.trial043.stdout:506 Cannot talk to daemon 2026-02-21T01:26:12.901 INFO:teuthology.orchestra.run.trial043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-21T01:26:12.905 INFO:teuthology.orchestra.run.trial046.stderr:sudo: ntpd: command not found 2026-02-21T01:26:12.914 INFO:teuthology.orchestra.run.trial043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-21T01:26:12.915 INFO:teuthology.orchestra.run.trial046.stdout:506 Cannot talk to daemon 2026-02-21T01:26:12.926 INFO:teuthology.orchestra.run.trial046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-21T01:26:12.938 INFO:teuthology.orchestra.run.trial046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-21T01:26:12.957 INFO:teuthology.orchestra.run.trial043.stderr:bash: line 1: ntpq: command not found 2026-02-21T01:26:12.975 INFO:teuthology.orchestra.run.trial043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-21T01:26:12.976 INFO:teuthology.orchestra.run.trial043.stdout:=============================================================================== 2026-02-21T01:26:12.976 INFO:teuthology.orchestra.run.trial043.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.976 INFO:teuthology.orchestra.run.trial043.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.976 INFO:teuthology.orchestra.run.trial043.stdout:^? time3.lshiy.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.976 INFO:teuthology.orchestra.run.trial043.stdout:^? 172-232-15-202.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.985 INFO:teuthology.orchestra.run.trial046.stderr:bash: line 1: ntpq: command not found 2026-02-21T01:26:12.997 INFO:teuthology.orchestra.run.trial046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-21T01:26:12.997 INFO:teuthology.orchestra.run.trial046.stdout:=============================================================================== 2026-02-21T01:26:12.997 INFO:teuthology.orchestra.run.trial046.stdout:^? 38.45.64.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.997 INFO:teuthology.orchestra.run.trial046.stdout:^? 172-232-15-202.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.997 INFO:teuthology.orchestra.run.trial046.stdout:^? chi2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.997 INFO:teuthology.orchestra.run.trial046.stdout:^? 50.205.57.38 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-21T01:26:12.998 INFO:teuthology.run_tasks:Running task install... 2026-02-21T01:26:13.012 DEBUG:teuthology.task.install:project ceph 2026-02-21T01:26:13.012 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}} 2026-02-21T01:26:13.012 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'} 2026-02-21T01:26:13.012 INFO:teuthology.task.install:Using flavor: default 2026-02-21T01:26:13.020 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-21T01:26:13.021 INFO:teuthology.task.install:extra packages: [] 2026-02-21T01:26:13.021 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-21T01:26:13.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-21T01:26:13.024 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-21T01:26:13.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-21T01:26:13.181 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-21T01:26:13.181 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-21T01:26:13.191 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-21T01:26:13.191 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-21T01:26:13.329 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-21T01:26:13.329 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:26:13.329 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-21T01:26:13.341 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-21T01:26:13.341 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:26:13.341 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-21T01:26:13.354 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-21T01:26:13.355 DEBUG:teuthology.orchestra.run.trial043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-21T01:26:13.366 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-21T01:26:13.367 DEBUG:teuthology.orchestra.run.trial046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-21T01:26:13.420 DEBUG:teuthology.orchestra.run.trial043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-21T01:26:13.431 DEBUG:teuthology.orchestra.run.trial046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-21T01:26:13.492 DEBUG:teuthology.orchestra.run.trial043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-21T01:26:13.503 DEBUG:teuthology.orchestra.run.trial046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-21T01:26:13.558 INFO:teuthology.orchestra.run.trial043.stdout:check_obsoletes = 1 2026-02-21T01:26:13.559 DEBUG:teuthology.orchestra.run.trial043:> sudo yum clean all 2026-02-21T01:26:13.566 INFO:teuthology.orchestra.run.trial046.stdout:check_obsoletes = 1 2026-02-21T01:26:13.567 DEBUG:teuthology.orchestra.run.trial046:> sudo yum clean all 2026-02-21T01:26:13.718 INFO:teuthology.orchestra.run.trial043.stdout:41 files removed 2026-02-21T01:26:13.725 INFO:teuthology.orchestra.run.trial046.stdout:41 files removed 2026-02-21T01:26:13.732 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-radosgw 2026-02-21T01:26:13.739 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-radosgw 2026-02-21T01:26:14.011 INFO:teuthology.orchestra.run.trial043.stdout:ceph packages for x86_64 652 kB/s | 87 kB 00:00 2026-02-21T01:26:14.012 INFO:teuthology.orchestra.run.trial046.stdout:ceph packages for x86_64 668 kB/s | 87 kB 00:00 2026-02-21T01:26:14.151 INFO:teuthology.orchestra.run.trial043.stdout:ceph noarch packages 157 kB/s | 18 kB 00:00 2026-02-21T01:26:14.153 INFO:teuthology.orchestra.run.trial046.stdout:ceph noarch packages 155 kB/s | 18 kB 00:00 2026-02-21T01:26:14.281 INFO:teuthology.orchestra.run.trial043.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-21T01:26:14.281 INFO:teuthology.orchestra.run.trial046.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-21T01:26:14.959 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-21T01:26:15.664 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-21T01:26:15.853 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - AppStream 72 MB/s | 27 MB 00:00 2026-02-21T01:26:18.716 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - CRB 16 MB/s | 7.8 MB 00:00 2026-02-21T01:26:18.834 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-21T01:26:19.614 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 20 kB 00:00 2026-02-21T01:26:20.896 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-21T01:26:22.085 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 7.8 MB 00:00 2026-02-21T01:26:23.109 INFO:teuthology.orchestra.run.trial043.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 20 kB 00:00 2026-02-21T01:26:23.928 INFO:teuthology.orchestra.run.trial043.stdout:Extra Packages for Enterprise Linux 27 MB/s | 20 MB 00:00 2026-02-21T01:26:24.069 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-21T01:26:25.261 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:25.262 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:25.262 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:26:25.262 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:25.262 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout:Upgrading: 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-21T01:26:25.263 INFO:teuthology.orchestra.run.trial046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-21T01:26:25.264 INFO:teuthology.orchestra.run.trial046.stdout:Installing weak dependencies: 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout:Install 32 Packages 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout:Upgrade 2 Packages 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 78 M 2026-02-21T01:26:25.265 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:26:25.857 INFO:teuthology.orchestra.run.trial046.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 16 MB/s | 5.9 MB 00:00 2026-02-21T01:26:25.907 INFO:teuthology.orchestra.run.trial046.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 502 kB/s | 25 kB 00:00 2026-02-21T01:26:25.975 INFO:teuthology.orchestra.run.trial046.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 13 MB/s | 869 kB 00:00 2026-02-21T01:26:26.033 INFO:teuthology.orchestra.run.trial046.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 4.2 MB/s | 250 kB 00:00 2026-02-21T01:26:26.521 INFO:teuthology.orchestra.run.trial046.stdout:(5/34): ceph-radosgw-20.2.0-681.g36d388f2.el9.x 23 MB/s | 24 MB 00:01 2026-02-21T01:26:26.529 INFO:teuthology.orchestra.run.trial046.stdout:(6/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 13 MB/s | 6.4 MB 00:00 2026-02-21T01:26:26.542 INFO:teuthology.orchestra.run.trial046.stdout:(7/34): python3-ceph-argparse-20.2.0-681.g36d38 2.1 MB/s | 45 kB 00:00 2026-02-21T01:26:26.550 INFO:teuthology.orchestra.run.trial046.stdout:(8/34): python3-ceph-common-20.2.0-681.g36d388f 8.2 MB/s | 175 kB 00:00 2026-02-21T01:26:26.566 INFO:teuthology.orchestra.run.trial046.stdout:(9/34): python3-cephfs-20.2.0-681.g36d388f2.el9 6.5 MB/s | 163 kB 00:00 2026-02-21T01:26:26.584 INFO:teuthology.orchestra.run.trial046.stdout:(10/34): python3-rados-20.2.0-681.g36d388f2.el9 9.2 MB/s | 323 kB 00:00 2026-02-21T01:26:26.596 INFO:teuthology.orchestra.run.trial046.stdout:(11/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 10 MB/s | 306 kB 00:00 2026-02-21T01:26:26.610 INFO:teuthology.orchestra.run.trial046.stdout:(12/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 3.8 MB/s | 99 kB 00:00 2026-02-21T01:26:26.663 INFO:teuthology.orchestra.run.trial046.stdout:(13/34): ceph-common-20.2.0-681.g36d388f2.el9.x 20 MB/s | 24 MB 00:01 2026-02-21T01:26:26.688 INFO:teuthology.orchestra.run.trial046.stdout:(14/34): mailcap-2.1.49-5.el9.noarch.rpm 360 kB/s | 33 kB 00:00 2026-02-21T01:26:26.689 INFO:teuthology.orchestra.run.trial046.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 3.8 MB/s | 104 kB 00:00 2026-02-21T01:26:26.698 INFO:teuthology.orchestra.run.trial046.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 18 MB/s | 160 kB 00:00 2026-02-21T01:26:26.703 INFO:teuthology.orchestra.run.trial046.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.2 MB/s | 45 kB 00:00 2026-02-21T01:26:26.705 INFO:teuthology.orchestra.run.trial046.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 9.2 MB/s | 164 kB 00:00 2026-02-21T01:26:26.713 INFO:teuthology.orchestra.run.trial046.stdout:(19/34): librdkafka-1.6.1-102.el9.x86_64.rpm 65 MB/s | 662 kB 00:00 2026-02-21T01:26:26.718 INFO:teuthology.orchestra.run.trial046.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 23 MB/s | 292 kB 00:00 2026-02-21T01:26:26.719 INFO:teuthology.orchestra.run.trial046.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 39 MB/s | 240 kB 00:00 2026-02-21T01:26:26.722 INFO:teuthology.orchestra.run.trial046.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 8.6 MB/s | 37 kB 00:00 2026-02-21T01:26:26.724 INFO:teuthology.orchestra.run.trial046.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-21T01:26:26.760 INFO:teuthology.orchestra.run.trial046.stdout:(24/34): pciutils-3.7.0-7.el9.x86_64.rpm 620 kB/s | 93 kB 00:00 2026-02-21T01:26:26.813 INFO:teuthology.orchestra.run.trial046.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 471 kB/s | 25 kB 00:00 2026-02-21T01:26:26.841 INFO:teuthology.orchestra.run.trial046.stdout:(26/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.5 MB/s | 308 kB 00:00 2026-02-21T01:26:26.849 INFO:teuthology.orchestra.run.trial046.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 1.3 MB/s | 49 kB 00:00 2026-02-21T01:26:26.858 INFO:teuthology.orchestra.run.trial046.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 3.7 MB/s | 67 kB 00:00 2026-02-21T01:26:26.881 INFO:teuthology.orchestra.run.trial046.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 8.5 MB/s | 191 kB 00:00 2026-02-21T01:26:26.911 INFO:teuthology.orchestra.run.trial046.stdout:(30/34): libarrow-9.0.0-15.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2026-02-21T01:26:26.932 INFO:teuthology.orchestra.run.trial046.stdout:(31/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 9.9 MB/s | 838 kB 00:00 2026-02-21T01:26:26.943 INFO:teuthology.orchestra.run.trial046.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 25 MB/s | 1.6 MB 00:00 2026-02-21T01:26:27.028 INFO:teuthology.orchestra.run.trial046.stdout:(33/34): librados2-20.2.0-681.g36d388f2.el9.x86 30 MB/s | 3.5 MB 00:00 2026-02-21T01:26:27.031 INFO:teuthology.orchestra.run.trial046.stdout:(34/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 29 MB/s | 2.8 MB 00:00 2026-02-21T01:26:27.033 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:27.033 INFO:teuthology.orchestra.run.trial046.stdout:Total 44 MB/s | 78 MB 00:01 2026-02-21T01:26:27.115 INFO:teuthology.orchestra.run.trial043.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-21T01:26:27.123 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:26:27.141 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:26:27.141 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:26:27.435 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:26:27.436 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:26:27.764 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:26:27.777 INFO:teuthology.orchestra.run.trial046.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-21T01:26:27.929 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-21T01:26:27.933 INFO:teuthology.orchestra.run.trial046.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-21T01:26:27.961 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-21T01:26:27.998 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-21T01:26:27.999 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-21T01:26:28.011 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-21T01:26:28.020 INFO:teuthology.orchestra.run.trial046.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-21T01:26:28.022 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-21T01:26:28.026 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-21T01:26:28.030 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-21T01:26:28.039 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-21T01:26:28.050 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-21T01:26:28.051 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-21T01:26:28.065 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-21T01:26:28.096 INFO:teuthology.orchestra.run.trial046.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-21T01:26:28.100 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-21T01:26:28.106 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-21T01:26:28.109 INFO:teuthology.orchestra.run.trial046.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-21T01:26:28.114 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-21T01:26:28.236 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-21T01:26:28.237 INFO:teuthology.orchestra.run.trial046.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-21T01:26:28.263 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-21T01:26:28.265 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-21T01:26:28.271 INFO:teuthology.orchestra.run.trial046.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-21T01:26:28.303 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:26:28.304 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:28.304 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:26:28.304 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:28.304 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:26:28.304 INFO:teuthology.orchestra.run.trial043.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-21T01:26:28.304 INFO:teuthology.orchestra.run.trial043.stdout:Upgrading: 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-21T01:26:28.305 INFO:teuthology.orchestra.run.trial043.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout:Installing weak dependencies: 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout:Install 32 Packages 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout:Upgrade 2 Packages 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 78 M 2026-02-21T01:26:28.306 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:26:28.548 INFO:teuthology.orchestra.run.trial046.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-21T01:26:28.549 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-21T01:26:28.566 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-21T01:26:28.569 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-21T01:26:28.574 INFO:teuthology.orchestra.run.trial046.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-21T01:26:28.576 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-21T01:26:28.577 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-21T01:26:28.595 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-21T01:26:28.598 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-21T01:26:28.630 INFO:teuthology.orchestra.run.trial046.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-21T01:26:28.632 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-21T01:26:28.904 INFO:teuthology.orchestra.run.trial043.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 15 MB/s | 5.9 MB 00:00 2026-02-21T01:26:28.951 INFO:teuthology.orchestra.run.trial043.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 530 kB/s | 25 kB 00:00 2026-02-21T01:26:29.017 INFO:teuthology.orchestra.run.trial043.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 13 MB/s | 869 kB 00:00 2026-02-21T01:26:29.073 INFO:teuthology.orchestra.run.trial043.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 4.4 MB/s | 250 kB 00:00 2026-02-21T01:26:29.501 INFO:teuthology.orchestra.run.trial043.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 15 MB/s | 6.4 MB 00:00 2026-02-21T01:26:29.542 INFO:teuthology.orchestra.run.trial043.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 1.1 MB/s | 45 kB 00:00 2026-02-21T01:26:29.588 INFO:teuthology.orchestra.run.trial043.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 3.8 MB/s | 175 kB 00:00 2026-02-21T01:26:29.657 INFO:teuthology.orchestra.run.trial043.stdout:(8/34): ceph-radosgw-20.2.0-681.g36d388f2.el9.x 20 MB/s | 24 MB 00:01 2026-02-21T01:26:29.690 INFO:teuthology.orchestra.run.trial043.stdout:(9/34): ceph-common-20.2.0-681.g36d388f2.el9.x8 20 MB/s | 24 MB 00:01 2026-02-21T01:26:29.691 INFO:teuthology.orchestra.run.trial043.stdout:(10/34): python3-cephfs-20.2.0-681.g36d388f2.el 1.5 MB/s | 163 kB 00:00 2026-02-21T01:26:29.692 INFO:teuthology.orchestra.run.trial043.stdout:(11/34): python3-rados-20.2.0-681.g36d388f2.el9 8.9 MB/s | 323 kB 00:00 2026-02-21T01:26:29.703 INFO:teuthology.orchestra.run.trial043.stdout:(12/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 24 MB/s | 306 kB 00:00 2026-02-21T01:26:29.705 INFO:teuthology.orchestra.run.trial043.stdout:(13/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 7.0 MB/s | 99 kB 00:00 2026-02-21T01:26:29.711 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-21T01:26:29.714 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-21T01:26:29.763 INFO:teuthology.orchestra.run.trial043.stdout:(14/34): mailcap-2.1.49-5.el9.noarch.rpm 474 kB/s | 33 kB 00:00 2026-02-21T01:26:29.780 INFO:teuthology.orchestra.run.trial043.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.2 MB/s | 93 kB 00:00 2026-02-21T01:26:30.014 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-21T01:26:30.017 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-21T01:26:30.056 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-21T01:26:30.057 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-21T01:26:30.057 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-21T01:26:30.057 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:30.060 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-21T01:26:30.364 INFO:teuthology.orchestra.run.trial043.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 158 kB/s | 104 kB 00:00 2026-02-21T01:26:30.483 INFO:teuthology.orchestra.run.trial043.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 227 kB/s | 164 kB 00:00 2026-02-21T01:26:30.489 INFO:teuthology.orchestra.run.trial043.stdout:(18/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 226 kB/s | 160 kB 00:00 2026-02-21T01:26:30.930 INFO:teuthology.orchestra.run.trial043.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 80 kB/s | 45 kB 00:00 2026-02-21T01:26:31.266 INFO:teuthology.orchestra.run.trial043.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 376 kB/s | 292 kB 00:00 2026-02-21T01:26:31.396 INFO:teuthology.orchestra.run.trial043.stdout:(21/34): librdkafka-1.6.1-102.el9.x86_64.rpm 726 kB/s | 662 kB 00:00 2026-02-21T01:26:31.685 INFO:teuthology.orchestra.run.trial043.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 318 kB/s | 240 kB 00:00 2026-02-21T01:26:31.830 INFO:teuthology.orchestra.run.trial043.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 66 kB/s | 37 kB 00:00 2026-02-21T01:26:31.996 INFO:teuthology.orchestra.run.trial043.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 111 kB/s | 66 kB 00:00 2026-02-21T01:26:32.396 INFO:teuthology.orchestra.run.trial043.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 62 kB/s | 25 kB 00:00 2026-02-21T01:26:32.474 INFO:teuthology.orchestra.run.trial043.stdout:(26/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 390 kB/s | 308 kB 00:00 2026-02-21T01:26:32.553 INFO:teuthology.orchestra.run.trial043.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 313 kB/s | 49 kB 00:00 2026-02-21T01:26:32.553 INFO:teuthology.orchestra.run.trial043.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 850 kB/s | 67 kB 00:00 2026-02-21T01:26:32.788 INFO:teuthology.orchestra.run.trial043.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 816 kB/s | 191 kB 00:00 2026-02-21T01:26:33.567 INFO:teuthology.orchestra.run.trial043.stdout:(30/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 826 kB/s | 838 kB 00:01 2026-02-21T01:26:33.685 INFO:teuthology.orchestra.run.trial043.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 30 MB/s | 3.5 MB 00:00 2026-02-21T01:26:33.739 INFO:teuthology.orchestra.run.trial043.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 53 MB/s | 2.8 MB 00:00 2026-02-21T01:26:34.596 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-21T01:26:34.596 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /sys 2026-02-21T01:26:34.596 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /proc 2026-02-21T01:26:34.597 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /mnt 2026-02-21T01:26:34.597 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /var/tmp 2026-02-21T01:26:34.597 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /home 2026-02-21T01:26:34.597 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /root 2026-02-21T01:26:34.597 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /tmp 2026-02-21T01:26:34.597 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:34.661 INFO:teuthology.orchestra.run.trial043.stdout:(33/34): thrift-0.15.0-4.el9.x86_64.rpm 865 kB/s | 1.6 MB 00:01 2026-02-21T01:26:35.618 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-21T01:26:35.641 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-21T01:26:35.641 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:35.641 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-21T01:26:35.641 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-21T01:26:35.642 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-21T01:26:35.642 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:35.643 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-21T01:26:35.656 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-21T01:26:35.656 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-21T01:26:35.714 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-21T01:26:35.714 INFO:teuthology.orchestra.run.trial046.stdout:Creating group 'qat' with GID 992. 2026-02-21T01:26:35.714 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:36.063 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-21T01:26:36.063 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-21T01:26:36.063 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-21T01:26:36.063 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-21T01:26:36.063 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-21T01:26:36.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-21T01:26:36.065 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-21T01:26:36.066 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-21T01:26:36.123 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-21T01:26:36.123 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:36.123 INFO:teuthology.orchestra.run.trial046.stdout:Upgraded: 2026-02-21T01:26:36.123 INFO:teuthology.orchestra.run.trial046.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.123 INFO:teuthology.orchestra.run.trial046.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.123 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:26:36.123 INFO:teuthology.orchestra.run.trial046.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-21T01:26:36.124 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: re2-1:20211101-20.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:36.125 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:36.166 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-test 2026-02-21T01:26:36.473 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:12 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:36.557 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-21T01:26:36.558 INFO:teuthology.orchestra.run.trial046.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout:Install 5 Packages 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 85 M 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 365 M 2026-02-21T01:26:36.559 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:26:36.704 INFO:teuthology.orchestra.run.trial046.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 1.9 MB/s | 164 kB 00:00 2026-02-21T01:26:36.774 INFO:teuthology.orchestra.run.trial046.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-21T01:26:36.803 INFO:teuthology.orchestra.run.trial046.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.2 MB/s | 64 kB 00:00 2026-02-21T01:26:36.866 INFO:teuthology.orchestra.run.trial046.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2026-02-21T01:26:37.273 INFO:teuthology.orchestra.run.trial043.stdout:(34/34): libarrow-9.0.0-15.el9.x86_64.rpm 830 kB/s | 4.4 MB 00:05 2026-02-21T01:26:37.277 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:37.277 INFO:teuthology.orchestra.run.trial043.stdout:Total 8.6 MB/s | 78 MB 00:08 2026-02-21T01:26:37.366 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:26:37.383 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:26:37.384 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:26:37.676 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:26:37.677 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:26:38.018 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:26:38.033 INFO:teuthology.orchestra.run.trial043.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-21T01:26:38.186 INFO:teuthology.orchestra.run.trial043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-21T01:26:38.191 INFO:teuthology.orchestra.run.trial043.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-21T01:26:38.221 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-21T01:26:38.259 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-21T01:26:38.260 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-21T01:26:38.271 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-21T01:26:38.274 INFO:teuthology.orchestra.run.trial046.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 51 MB/s | 84 MB 00:01 2026-02-21T01:26:38.276 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:38.276 INFO:teuthology.orchestra.run.trial046.stdout:Total 49 MB/s | 85 MB 00:01 2026-02-21T01:26:38.281 INFO:teuthology.orchestra.run.trial043.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-21T01:26:38.283 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-21T01:26:38.286 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-21T01:26:38.290 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-21T01:26:38.299 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-21T01:26:38.304 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:26:38.310 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-21T01:26:38.311 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-21T01:26:38.314 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:26:38.314 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:26:38.325 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-21T01:26:38.359 INFO:teuthology.orchestra.run.trial043.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-21T01:26:38.365 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-21T01:26:38.371 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-21T01:26:38.373 INFO:teuthology.orchestra.run.trial043.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-21T01:26:38.378 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-21T01:26:38.501 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-21T01:26:38.502 INFO:teuthology.orchestra.run.trial043.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-21T01:26:38.527 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-21T01:26:38.529 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-21T01:26:38.535 INFO:teuthology.orchestra.run.trial043.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-21T01:26:38.603 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:26:38.603 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:26:38.814 INFO:teuthology.orchestra.run.trial043.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-21T01:26:38.815 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-21T01:26:38.832 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-21T01:26:38.837 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-21T01:26:38.842 INFO:teuthology.orchestra.run.trial043.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-21T01:26:38.845 INFO:teuthology.orchestra.run.trial043.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-21T01:26:38.846 INFO:teuthology.orchestra.run.trial043.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-21T01:26:38.865 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-21T01:26:38.868 INFO:teuthology.orchestra.run.trial043.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-21T01:26:38.902 INFO:teuthology.orchestra.run.trial043.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-21T01:26:38.904 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-21T01:26:38.917 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:26:38.923 INFO:teuthology.orchestra.run.trial046.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-21T01:26:38.927 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-21T01:26:38.935 INFO:teuthology.orchestra.run.trial046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-21T01:26:38.935 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-21T01:26:39.981 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-21T01:26:39.984 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-21T01:26:40.279 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-21T01:26:40.283 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-21T01:26:40.319 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-21T01:26:40.320 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-21T01:26:40.320 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-21T01:26:40.320 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:40.323 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-21T01:26:42.647 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-21T01:26:42.665 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-21T01:26:43.011 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-21T01:26:43.011 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-21T01:26:43.011 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-21T01:26:43.011 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-21T01:26:43.011 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-21T01:26:43.064 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:43.065 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:43.101 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph 2026-02-21T01:26:43.408 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:19 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:43.491 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:43.492 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:43.492 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:26:43.492 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-21T01:26:43.493 INFO:teuthology.orchestra.run.trial046.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-21T01:26:43.494 INFO:teuthology.orchestra.run.trial046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-21T01:26:43.495 INFO:teuthology.orchestra.run.trial046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-21T01:26:43.496 INFO:teuthology.orchestra.run.trial046.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-21T01:26:43.497 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:43.497 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:26:43.497 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:43.497 INFO:teuthology.orchestra.run.trial046.stdout:Install 40 Packages 2026-02-21T01:26:43.497 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:43.498 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 30 M 2026-02-21T01:26:43.498 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 100 M 2026-02-21T01:26:43.498 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:26:44.351 INFO:teuthology.orchestra.run.trial046.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 108 kB/s | 6.5 kB 00:00 2026-02-21T01:26:44.439 INFO:teuthology.orchestra.run.trial046.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 6.3 MB/s | 961 kB 00:00 2026-02-21T01:26:44.465 INFO:teuthology.orchestra.run.trial046.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 13 MB/s | 2.3 MB 00:00 2026-02-21T01:26:44.504 INFO:teuthology.orchestra.run.trial046.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 7.4 MB/s | 290 kB 00:00 2026-02-21T01:26:44.604 INFO:teuthology.orchestra.run.trial046.stdout:(5/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 20 MB/s | 5.1 MB 00:00 2026-02-21T01:26:44.787 INFO:teuthology.orchestra.run.trial046.stdout:(6/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 143 kB/s | 40 kB 00:00 2026-02-21T01:26:44.841 INFO:teuthology.orchestra.run.trial046.stdout:(7/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_6 42 MB/s | 17 MB 00:00 2026-02-21T01:26:44.850 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-21T01:26:44.850 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /sys 2026-02-21T01:26:44.850 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /proc 2026-02-21T01:26:44.850 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /mnt 2026-02-21T01:26:44.850 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /var/tmp 2026-02-21T01:26:44.851 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /home 2026-02-21T01:26:44.851 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /root 2026-02-21T01:26:44.851 INFO:teuthology.orchestra.run.trial043.stdout:skipping the directory /tmp 2026-02-21T01:26:44.851 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:44.961 INFO:teuthology.orchestra.run.trial046.stdout:(8/40): libconfig-1.7.2-9.el9.x86_64.rpm 202 kB/s | 72 kB 00:00 2026-02-21T01:26:45.104 INFO:teuthology.orchestra.run.trial046.stdout:(9/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 798 kB/s | 253 kB 00:00 2026-02-21T01:26:45.133 INFO:teuthology.orchestra.run.trial046.stdout:(10/40): python3-ply-3.11-14.el9.noarch.rpm 618 kB/s | 106 kB 00:00 2026-02-21T01:26:45.208 INFO:teuthology.orchestra.run.trial046.stdout:(11/40): python3-pycparser-2.20-6.el9.noarch.rp 1.3 MB/s | 135 kB 00:00 2026-02-21T01:26:45.258 INFO:teuthology.orchestra.run.trial046.stdout:(12/40): python3-pyparsing-2.4.7-9.el9.noarch.r 1.2 MB/s | 150 kB 00:00 2026-02-21T01:26:45.310 INFO:teuthology.orchestra.run.trial046.stdout:(13/40): python3-requests-2.25.1-10.el9.noarch. 1.2 MB/s | 126 kB 00:00 2026-02-21T01:26:45.399 INFO:teuthology.orchestra.run.trial046.stdout:(14/40): python3-urllib3-1.26.5-7.el9.noarch.rp 1.5 MB/s | 218 kB 00:00 2026-02-21T01:26:45.422 INFO:teuthology.orchestra.run.trial046.stdout:(15/40): unzip-6.0-59.el9.x86_64.rpm 1.6 MB/s | 182 kB 00:00 2026-02-21T01:26:45.519 INFO:teuthology.orchestra.run.trial046.stdout:(16/40): python3-cryptography-36.0.1-5.el9.x86_ 1.8 MB/s | 1.2 MB 00:00 2026-02-21T01:26:45.535 INFO:teuthology.orchestra.run.trial046.stdout:(17/40): zip-3.0-35.el9.x86_64.rpm 1.9 MB/s | 266 kB 00:00 2026-02-21T01:26:45.547 INFO:teuthology.orchestra.run.trial046.stdout:(18/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 1.9 MB/s | 246 kB 00:00 2026-02-21T01:26:45.569 INFO:teuthology.orchestra.run.trial046.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 3.5 MB/s | 77 kB 00:00 2026-02-21T01:26:45.612 INFO:teuthology.orchestra.run.trial046.stdout:(20/40): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2026-02-21T01:26:45.635 INFO:teuthology.orchestra.run.trial046.stdout:(21/40): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-21T01:26:45.688 INFO:teuthology.orchestra.run.trial046.stdout:(22/40): lua-devel-5.4.4-4.el9.x86_64.rpm 293 kB/s | 22 kB 00:00 2026-02-21T01:26:45.701 INFO:teuthology.orchestra.run.trial046.stdout:(23/40): python3-toml-0.10.2-6.el9.noarch.rpm 314 kB/s | 42 kB 00:00 2026-02-21T01:26:45.800 INFO:teuthology.orchestra.run.trial046.stdout:(24/40): luarocks-3.9.2-5.el9.noarch.rpm 918 kB/s | 151 kB 00:00 2026-02-21T01:26:45.802 INFO:teuthology.orchestra.run.trial046.stdout:(25/40): python3-autocommand-2.2.2-8.el9.noarch 258 kB/s | 29 kB 00:00 2026-02-21T01:26:45.820 INFO:teuthology.orchestra.run.trial046.stdout:(26/40): python3-backports-tarfile-1.2.0-1.el9. 508 kB/s | 60 kB 00:00 2026-02-21T01:26:45.826 INFO:teuthology.orchestra.run.trial046.stdout:(27/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.6 MB/s | 43 kB 00:00 2026-02-21T01:26:45.849 INFO:teuthology.orchestra.run.trial046.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 468 kB/s | 11 kB 00:00 2026-02-21T01:26:45.872 INFO:teuthology.orchestra.run.trial046.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 748 kB/s | 18 kB 00:00 2026-02-21T01:26:45.879 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-21T01:26:45.890 INFO:teuthology.orchestra.run.trial046.stdout:(30/40): python3-cheroot-10.0.1-4.el9.noarch.rp 1.9 MB/s | 173 kB 00:00 2026-02-21T01:26:45.896 INFO:teuthology.orchestra.run.trial046.stdout:(31/40): python3-jaraco-collections-3.0.0-8.el9 977 kB/s | 23 kB 00:00 2026-02-21T01:26:45.901 INFO:teuthology.orchestra.run.trial046.stdout:(32/40): python3-cherrypy-18.6.1-2.el9.noarch.r 4.3 MB/s | 358 kB 00:00 2026-02-21T01:26:45.902 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-21T01:26:45.903 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:45.903 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-21T01:26:45.903 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-21T01:26:45.903 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-21T01:26:45.903 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:45.905 INFO:teuthology.orchestra.run.trial043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-21T01:26:45.918 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-21T01:26:45.918 INFO:teuthology.orchestra.run.trial043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-21T01:26:45.918 INFO:teuthology.orchestra.run.trial046.stdout:(33/40): python3-jaraco-context-6.0.1-3.el9.noa 730 kB/s | 20 kB 00:00 2026-02-21T01:26:45.920 INFO:teuthology.orchestra.run.trial046.stdout:(34/40): python3-jaraco-functools-3.5.0-2.el9.n 816 kB/s | 19 kB 00:00 2026-02-21T01:26:45.923 INFO:teuthology.orchestra.run.trial046.stdout:(35/40): python3-jaraco-text-4.0.0-2.el9.noarch 1.1 MB/s | 26 kB 00:00 2026-02-21T01:26:45.943 INFO:teuthology.orchestra.run.trial046.stdout:(36/40): python3-portend-3.1.0-2.el9.noarch.rpm 716 kB/s | 16 kB 00:00 2026-02-21T01:26:45.948 INFO:teuthology.orchestra.run.trial046.stdout:(37/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2026-02-21T01:26:45.950 INFO:teuthology.orchestra.run.trial046.stdout:(38/40): python3-more-itertools-8.12.0-2.el9.no 2.4 MB/s | 79 kB 00:00 2026-02-21T01:26:45.969 INFO:teuthology.orchestra.run.trial046.stdout:(39/40): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2026-02-21T01:26:45.971 INFO:teuthology.orchestra.run.trial046.stdout:(40/40): python3-zc-lockfile-2.0-10.el9.noarch. 876 kB/s | 20 kB 00:00 2026-02-21T01:26:45.972 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:45.972 INFO:teuthology.orchestra.run.trial046.stdout:Total 12 MB/s | 30 MB 00:02 2026-02-21T01:26:45.974 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-21T01:26:45.974 INFO:teuthology.orchestra.run.trial043.stdout:Creating group 'qat' with GID 992. 2026-02-21T01:26:45.975 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:46.118 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:26:46.136 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:26:46.137 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:26:46.282 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:26:46.282 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:26:46.325 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-21T01:26:46.325 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-21T01:26:46.325 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-21T01:26:46.325 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-21T01:26:46.325 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-21T01:26:46.325 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-21T01:26:46.326 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-21T01:26:46.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-21T01:26:46.328 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-21T01:26:46.328 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-21T01:26:46.328 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-21T01:26:46.328 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-21T01:26:46.387 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-21T01:26:46.387 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout:Upgraded: 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-21T01:26:46.388 INFO:teuthology.orchestra.run.trial043.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: re2-1:20211101-20.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:46.389 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:26:46.431 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-test 2026-02-21T01:26:46.475 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:26:46.477 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-21T01:26:46.482 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-21T01:26:46.486 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-21T01:26:46.489 INFO:teuthology.orchestra.run.trial046.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-21T01:26:46.495 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-21T01:26:46.518 INFO:teuthology.orchestra.run.trial046.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-21T01:26:46.522 INFO:teuthology.orchestra.run.trial046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-21T01:26:46.527 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-21T01:26:46.532 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-21T01:26:46.538 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-21T01:26:46.541 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-21T01:26:46.547 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-21T01:26:46.553 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-21T01:26:46.556 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-21T01:26:46.561 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-21T01:26:46.565 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-21T01:26:46.572 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-21T01:26:46.575 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-21T01:26:46.598 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-21T01:26:46.610 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-21T01:26:46.615 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-21T01:26:46.625 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-21T01:26:46.631 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-21T01:26:46.644 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-21T01:26:46.659 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-21T01:26:46.735 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-21T01:26:46.740 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:19 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:26:46.743 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-21T01:26:46.766 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-21T01:26:46.796 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-21T01:26:46.801 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-21T01:26:46.822 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:26:46.823 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:46.823 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:26:46.823 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout:Install 5 Packages 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:46.824 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 85 M 2026-02-21T01:26:46.825 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 365 M 2026-02-21T01:26:46.825 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:26:46.848 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-21T01:26:46.890 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-21T01:26:46.891 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-21T01:26:46.914 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-21T01:26:46.914 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:46.914 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-21T01:26:46.914 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-21T01:26:46.914 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-21T01:26:46.915 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:46.919 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-21T01:26:46.936 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-21T01:26:46.936 INFO:teuthology.orchestra.run.trial046.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-21T01:26:46.936 INFO:teuthology.orchestra.run.trial046.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-21T01:26:46.936 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:46.945 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-21T01:26:46.969 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-21T01:26:46.969 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-21T01:26:46.969 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:46.987 INFO:teuthology.orchestra.run.trial043.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.3 MB/s | 233 kB 00:00 2026-02-21T01:26:47.007 INFO:teuthology.orchestra.run.trial043.stdout:(2/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 1.8 MB/s | 164 kB 00:00 2026-02-21T01:26:47.019 INFO:teuthology.orchestra.run.trial043.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 9.2 MB/s | 303 kB 00:00 2026-02-21T01:26:47.037 INFO:teuthology.orchestra.run.trial043.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.1 MB/s | 64 kB 00:00 2026-02-21T01:26:47.656 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-21T01:26:47.657 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-21T01:26:47.683 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-21T01:26:47.683 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:47.683 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-21T01:26:47.683 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-21T01:26:47.683 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-21T01:26:47.683 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:47.896 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-21T01:26:47.918 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-21T01:26:47.918 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:47.918 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-21T01:26:47.918 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-21T01:26:47.918 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-21T01:26:47.918 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:48.015 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-21T01:26:48.035 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-21T01:26:48.035 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:48.035 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-21T01:26:48.035 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-21T01:26:48.036 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-21T01:26:48.036 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:48.052 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-21T01:26:48.376 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-21T01:26:48.377 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-21T01:26:48.378 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-21T01:26:48.379 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-21T01:26:48.380 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-21T01:26:48.380 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-21T01:26:48.380 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-21T01:26:48.380 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-21T01:26:48.380 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: lua-5.4.4-4.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-21T01:26:48.433 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-ply-3.11-14.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: unzip-6.0-59.el9.x86_64 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: zip-3.0-35.el9.x86_64 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:48.434 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:48.468 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-base 2026-02-21T01:26:48.566 INFO:teuthology.orchestra.run.trial043.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 51 MB/s | 84 MB 00:01 2026-02-21T01:26:48.567 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:48.568 INFO:teuthology.orchestra.run.trial043.stdout:Total 49 MB/s | 85 MB 00:01 2026-02-21T01:26:48.591 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:26:48.602 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:26:48.602 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:26:48.773 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:24 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:48.837 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:26:48.854 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:48.855 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:26:48.855 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:48.874 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install cephadm 2026-02-21T01:26:48.890 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:26:48.890 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:26:49.183 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:25 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:49.205 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:26:49.211 INFO:teuthology.orchestra.run.trial043.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-21T01:26:49.215 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-21T01:26:49.223 INFO:teuthology.orchestra.run.trial043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-21T01:26:49.224 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-21T01:26:49.265 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:49.266 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:49.266 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 1.0 M 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 1.0 M 2026-02-21T01:26:49.267 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:26:49.403 INFO:teuthology.orchestra.run.trial046.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 7.3 MB/s | 1.0 MB 00:00 2026-02-21T01:26:49.403 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:49.404 INFO:teuthology.orchestra.run.trial046.stdout:Total 7.3 MB/s | 1.0 MB 00:00 2026-02-21T01:26:49.404 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:26:49.406 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:26:49.406 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:26:49.410 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:26:49.410 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:26:49.427 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:26:49.494 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:49.507 INFO:teuthology.orchestra.run.trial046.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:49.567 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:49.621 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:49.621 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:49.621 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:26:49.621 INFO:teuthology.orchestra.run.trial046.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:26:49.621 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:49.621 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:49.648 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-immutable-object-cache 2026-02-21T01:26:49.953 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:25 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:50.035 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:50.035 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:50.035 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-21T01:26:50.035 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 154 k 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 447 k 2026-02-21T01:26:50.036 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:26:50.122 INFO:teuthology.orchestra.run.trial046.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 1.8 MB/s | 154 kB 00:00 2026-02-21T01:26:50.122 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:50.122 INFO:teuthology.orchestra.run.trial046.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-21T01:26:50.122 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:26:50.126 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:26:50.126 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:26:50.152 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:26:50.152 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:26:50.201 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:26:50.202 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-21T01:26:50.223 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-21T01:26:50.224 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:50.224 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-21T01:26:50.224 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:50.526 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-21T01:26:50.526 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:50.526 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:26:50.526 INFO:teuthology.orchestra.run.trial046.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:50.526 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:50.526 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:50.553 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr 2026-02-21T01:26:50.855 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:26 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:50.919 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:26:50.936 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:50.937 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:26:50.937 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:50.957 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-dashboard 2026-02-21T01:26:51.259 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:27 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:51.341 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:51.342 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:51.342 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:26:51.342 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-21T01:26:51.343 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout:Install 14 Packages 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 16 M 2026-02-21T01:26:51.344 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 158 M 2026-02-21T01:26:51.345 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:26:51.668 INFO:teuthology.orchestra.run.trial046.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 248 kB/s | 17 kB 00:00 2026-02-21T01:26:51.681 INFO:teuthology.orchestra.run.trial046.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 520 kB/s | 43 kB 00:00 2026-02-21T01:26:51.885 INFO:teuthology.orchestra.run.trial046.stdout:(3/14): ceph-mgr-dashboard-20.2.0-681.g36d388f2 37 MB/s | 11 MB 00:00 2026-02-21T01:26:51.992 INFO:teuthology.orchestra.run.trial046.stdout:(4/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 153 kB/s | 48 kB 00:00 2026-02-21T01:26:52.339 INFO:teuthology.orchestra.run.trial046.stdout:(5/14): protobuf-3.14.0-17.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2026-02-21T01:26:52.392 INFO:teuthology.orchestra.run.trial046.stdout:(6/14): python3-protobuf-3.14.0-17.el9.noarch.r 528 kB/s | 267 kB 00:00 2026-02-21T01:26:52.512 INFO:teuthology.orchestra.run.trial046.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 163 kB/s | 19 kB 00:00 2026-02-21T01:26:52.647 INFO:teuthology.orchestra.run.trial046.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.8 MB/s | 551 kB 00:00 2026-02-21T01:26:52.693 INFO:teuthology.orchestra.run.trial046.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.0 MB/s | 144 kB 00:00 2026-02-21T01:26:52.737 INFO:teuthology.orchestra.run.trial046.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 694 kB/s | 31 kB 00:00 2026-02-21T01:26:52.756 INFO:teuthology.orchestra.run.trial046.stdout:(11/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.4 MB/s | 2.0 MB 00:00 2026-02-21T01:26:52.781 INFO:teuthology.orchestra.run.trial046.stdout:(12/14): python3-routes-2.5.1-5.el9.noarch.rpm 4.3 MB/s | 188 kB 00:00 2026-02-21T01:26:52.797 INFO:teuthology.orchestra.run.trial046.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 531 kB/s | 22 kB 00:00 2026-02-21T01:26:52.939 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-21T01:26:52.956 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-21T01:26:53.273 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-21T01:26:53.273 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-21T01:26:53.273 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-21T01:26:53.273 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-21T01:26:53.273 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:53.328 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:26:53.366 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph 2026-02-21T01:26:53.445 INFO:teuthology.orchestra.run.trial046.stdout:(14/14): protobuf-compiler-3.14.0-17.el9.x86_64 593 kB/s | 862 kB 00:01 2026-02-21T01:26:53.446 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:53.447 INFO:teuthology.orchestra.run.trial046.stdout:Total 7.5 MB/s | 16 MB 00:02 2026-02-21T01:26:53.484 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:26:53.493 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:26:53.493 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:26:53.587 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:26:53.588 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:26:53.676 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:26 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:26:53.704 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:26:53.711 INFO:teuthology.orchestra.run.trial046.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-21T01:26:53.715 INFO:teuthology.orchestra.run.trial046.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-21T01:26:53.719 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-21T01:26:53.730 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-21T01:26:53.732 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-21T01:26:53.759 INFO:teuthology.orchestra.run.trial046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-21T01:26:53.760 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-21T01:26:53.762 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-21T01:26:53.763 INFO:teuthology.orchestra.run.trial043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-21T01:26:53.764 INFO:teuthology.orchestra.run.trial043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-21T01:26:53.765 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:53.766 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:26:53.766 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:53.766 INFO:teuthology.orchestra.run.trial043.stdout:Install 40 Packages 2026-02-21T01:26:53.766 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:53.766 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 30 M 2026-02-21T01:26:53.767 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 100 M 2026-02-21T01:26:53.767 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:26:53.802 INFO:teuthology.orchestra.run.trial046.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-21T01:26:53.830 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-21T01:26:53.840 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-21T01:26:53.846 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-21T01:26:53.849 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-21T01:26:53.856 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-21T01:26:54.137 INFO:teuthology.orchestra.run.trial043.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 110 kB/s | 6.5 kB 00:00 2026-02-21T01:26:54.211 INFO:teuthology.orchestra.run.trial043.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 7.1 MB/s | 961 kB 00:00 2026-02-21T01:26:54.230 INFO:teuthology.orchestra.run.trial043.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 16 MB/s | 2.3 MB 00:00 2026-02-21T01:26:54.259 INFO:teuthology.orchestra.run.trial043.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 9.4 MB/s | 290 kB 00:00 2026-02-21T01:26:54.478 INFO:teuthology.orchestra.run.trial043.stdout:(5/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 15 MB/s | 5.1 MB 00:00 2026-02-21T01:26:54.619 INFO:teuthology.orchestra.run.trial043.stdout:(6/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_6 42 MB/s | 17 MB 00:00 2026-02-21T01:26:54.666 INFO:teuthology.orchestra.run.trial043.stdout:(7/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 99 kB/s | 40 kB 00:00 2026-02-21T01:26:54.977 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-21T01:26:54.982 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-21T01:26:55.034 INFO:teuthology.orchestra.run.trial043.stdout:(8/40): libconfig-1.7.2-9.el9.x86_64.rpm 129 kB/s | 72 kB 00:00 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-21T01:26:55.175 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-21T01:26:55.176 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-21T01:26:55.176 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-21T01:26:55.176 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-21T01:26:55.176 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-21T01:26:55.176 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-21T01:26:55.195 INFO:teuthology.orchestra.run.trial043.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 661 kB/s | 106 kB 00:00 2026-02-21T01:26:55.223 INFO:teuthology.orchestra.run.trial043.stdout:(10/40): python3-cryptography-36.0.1-5.el9.x86_ 2.2 MB/s | 1.2 MB 00:00 2026-02-21T01:26:55.230 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-21T01:26:55.230 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:55.230 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:26:55.230 INFO:teuthology.orchestra.run.trial046.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-21T01:26:55.230 INFO:teuthology.orchestra.run.trial046.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-21T01:26:55.231 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:55.232 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:26:55.260 INFO:teuthology.orchestra.run.trial043.stdout:(11/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 395 kB/s | 253 kB 00:00 2026-02-21T01:26:55.264 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-21T01:26:55.307 INFO:teuthology.orchestra.run.trial043.stdout:(12/40): python3-pyparsing-2.4.7-9.el9.noarch.r 1.8 MB/s | 150 kB 00:00 2026-02-21T01:26:55.344 INFO:teuthology.orchestra.run.trial043.stdout:(13/40): python3-requests-2.25.1-10.el9.noarch. 1.5 MB/s | 126 kB 00:00 2026-02-21T01:26:55.357 INFO:teuthology.orchestra.run.trial043.stdout:(14/40): python3-pycparser-2.20-6.el9.noarch.rp 836 kB/s | 135 kB 00:00 2026-02-21T01:26:55.392 INFO:teuthology.orchestra.run.trial043.stdout:(15/40): python3-urllib3-1.26.5-7.el9.noarch.rp 2.5 MB/s | 218 kB 00:00 2026-02-21T01:26:55.428 INFO:teuthology.orchestra.run.trial043.stdout:(16/40): unzip-6.0-59.el9.x86_64.rpm 2.1 MB/s | 182 kB 00:00 2026-02-21T01:26:55.520 INFO:teuthology.orchestra.run.trial043.stdout:(17/40): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-21T01:26:55.568 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:31 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:26:55.649 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout:====================================================================================== 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout:====================================================================================== 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout:====================================================================================== 2026-02-21T01:26:55.650 INFO:teuthology.orchestra.run.trial046.stdout:Install 12 Packages 2026-02-21T01:26:55.651 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:26:55.651 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 43 M 2026-02-21T01:26:55.651 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 234 M 2026-02-21T01:26:55.651 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:26:55.849 INFO:teuthology.orchestra.run.trial046.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 3.7 MB/s | 184 kB 00:00 2026-02-21T01:26:55.873 INFO:teuthology.orchestra.run.trial046.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 10 MB/s | 794 kB 00:00 2026-02-21T01:26:55.896 INFO:teuthology.orchestra.run.trial043.stdout:(18/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 489 kB/s | 246 kB 00:00 2026-02-21T01:26:55.900 INFO:teuthology.orchestra.run.trial043.stdout:(19/40): lua-5.4.4-4.el9.x86_64.rpm 400 kB/s | 188 kB 00:00 2026-02-21T01:26:55.985 INFO:teuthology.orchestra.run.trial043.stdout:(20/40): python3-libstoragemgmt-1.10.1-1.el9.x8 381 kB/s | 177 kB 00:00 2026-02-21T01:26:55.990 INFO:teuthology.orchestra.run.trial043.stdout:(21/40): python3-toml-0.10.2-6.el9.noarch.rpm 462 kB/s | 42 kB 00:00 2026-02-21T01:26:55.992 INFO:teuthology.orchestra.run.trial043.stdout:(22/40): python3-packaging-20.9-5.el9.noarch.rp 803 kB/s | 77 kB 00:00 2026-02-21T01:26:56.027 INFO:teuthology.orchestra.run.trial046.stdout:(3/12): ceph-mgr-diskprediction-local-20.2.0-68 32 MB/s | 7.4 MB 00:00 2026-02-21T01:26:56.075 INFO:teuthology.orchestra.run.trial043.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 358 kB/s | 29 kB 00:00 2026-02-21T01:26:56.095 INFO:teuthology.orchestra.run.trial043.stdout:(24/40): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2026-02-21T01:26:56.104 INFO:teuthology.orchestra.run.trial043.stdout:(25/40): lua-devel-5.4.4-4.el9.x86_64.rpm 186 kB/s | 22 kB 00:00 2026-02-21T01:26:56.120 INFO:teuthology.orchestra.run.trial043.stdout:(26/40): python3-backports-tarfile-1.2.0-1.el9. 1.3 MB/s | 60 kB 00:00 2026-02-21T01:26:56.122 INFO:teuthology.orchestra.run.trial043.stdout:(27/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.6 MB/s | 43 kB 00:00 2026-02-21T01:26:56.145 INFO:teuthology.orchestra.run.trial043.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 469 kB/s | 11 kB 00:00 2026-02-21T01:26:56.172 INFO:teuthology.orchestra.run.trial043.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 665 kB/s | 18 kB 00:00 2026-02-21T01:26:56.178 INFO:teuthology.orchestra.run.trial043.stdout:(30/40): python3-cherrypy-18.6.1-2.el9.noarch.r 6.0 MB/s | 358 kB 00:00 2026-02-21T01:26:56.197 INFO:teuthology.orchestra.run.trial043.stdout:(31/40): python3-cheroot-10.0.1-4.el9.noarch.rp 1.8 MB/s | 173 kB 00:00 2026-02-21T01:26:56.208 INFO:teuthology.orchestra.run.trial043.stdout:(32/40): python3-jaraco-collections-3.0.0-8.el9 643 kB/s | 23 kB 00:00 2026-02-21T01:26:56.217 INFO:teuthology.orchestra.run.trial043.stdout:(33/40): python3-jaraco-context-6.0.1-3.el9.noa 498 kB/s | 20 kB 00:00 2026-02-21T01:26:56.230 INFO:teuthology.orchestra.run.trial043.stdout:(34/40): python3-jaraco-functools-3.5.0-2.el9.n 595 kB/s | 19 kB 00:00 2026-02-21T01:26:56.234 INFO:teuthology.orchestra.run.trial043.stdout:(35/40): python3-jaraco-text-4.0.0-2.el9.noarch 990 kB/s | 26 kB 00:00 2026-02-21T01:26:56.251 INFO:teuthology.orchestra.run.trial043.stdout:(36/40): python3-more-itertools-8.12.0-2.el9.no 2.3 MB/s | 79 kB 00:00 2026-02-21T01:26:56.268 INFO:teuthology.orchestra.run.trial043.stdout:(37/40): python3-portend-3.1.0-2.el9.noarch.rpm 426 kB/s | 16 kB 00:00 2026-02-21T01:26:56.272 INFO:teuthology.orchestra.run.trial043.stdout:(38/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.3 MB/s | 90 kB 00:00 2026-02-21T01:26:56.273 INFO:teuthology.orchestra.run.trial043.stdout:(39/40): python3-tempora-5.0.0-2.el9.noarch.rpm 1.6 MB/s | 36 kB 00:00 2026-02-21T01:26:56.293 INFO:teuthology.orchestra.run.trial043.stdout:(40/40): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2026-02-21T01:26:56.295 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:56.295 INFO:teuthology.orchestra.run.trial043.stdout:Total 12 MB/s | 30 MB 00:02 2026-02-21T01:26:56.297 INFO:teuthology.orchestra.run.trial046.stdout:(4/12): flexiblas-3.0.4-9.el9.x86_64.rpm 66 kB/s | 30 kB 00:00 2026-02-21T01:26:56.436 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:26:56.444 INFO:teuthology.orchestra.run.trial046.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 36 kB/s | 15 kB 00:00 2026-02-21T01:26:56.454 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:26:56.455 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:26:56.473 INFO:teuthology.orchestra.run.trial046.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 239 kB/s | 42 kB 00:00 2026-02-21T01:26:56.598 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:26:56.599 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:26:56.790 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:26:56.791 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-21T01:26:56.796 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-21T01:26:56.801 INFO:teuthology.orchestra.run.trial043.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-21T01:26:56.803 INFO:teuthology.orchestra.run.trial043.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-21T01:26:56.805 INFO:teuthology.orchestra.run.trial046.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 736 kB/s | 244 kB 00:00 2026-02-21T01:26:56.809 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-21T01:26:56.833 INFO:teuthology.orchestra.run.trial043.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-21T01:26:56.838 INFO:teuthology.orchestra.run.trial043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-21T01:26:56.843 INFO:teuthology.orchestra.run.trial043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-21T01:26:56.847 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-21T01:26:56.854 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-21T01:26:56.857 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-21T01:26:56.863 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-21T01:26:56.868 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-21T01:26:56.872 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-21T01:26:56.877 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-21T01:26:56.881 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-21T01:26:56.888 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-21T01:26:56.891 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-21T01:26:56.913 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-21T01:26:56.926 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-21T01:26:56.931 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-21T01:26:56.941 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-21T01:26:56.947 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-21T01:26:56.960 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-21T01:26:56.975 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-21T01:26:57.050 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-21T01:26:57.058 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-21T01:26:57.081 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-21T01:26:57.109 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-21T01:26:57.115 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-21T01:26:57.161 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-21T01:26:57.204 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-21T01:26:57.205 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-21T01:26:57.228 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-21T01:26:57.228 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:57.228 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-21T01:26:57.228 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-21T01:26:57.228 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-21T01:26:57.228 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:57.232 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-21T01:26:57.250 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-21T01:26:57.250 INFO:teuthology.orchestra.run.trial043.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-21T01:26:57.250 INFO:teuthology.orchestra.run.trial043.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-21T01:26:57.250 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:57.259 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-21T01:26:57.282 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-21T01:26:57.283 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-21T01:26:57.283 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:57.541 INFO:teuthology.orchestra.run.trial046.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 8.3 MB/s | 6.1 MB 00:00 2026-02-21T01:26:57.645 INFO:teuthology.orchestra.run.trial046.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 4.1 MB/s | 442 kB 00:00 2026-02-21T01:26:57.887 INFO:teuthology.orchestra.run.trial046.stdout:(10/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 1.5 MB/s | 3.0 MB 00:02 2026-02-21T01:26:57.970 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-21T01:26:57.972 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-21T01:26:57.997 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-21T01:26:57.997 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:57.997 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-21T01:26:57.998 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-21T01:26:57.998 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-21T01:26:57.998 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:58.212 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-21T01:26:58.234 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-21T01:26:58.234 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:58.234 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-21T01:26:58.234 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-21T01:26:58.234 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-21T01:26:58.234 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:58.261 INFO:teuthology.orchestra.run.trial046.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 31 MB/s | 19 MB 00:00 2026-02-21T01:26:58.331 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-21T01:26:58.351 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-21T01:26:58.352 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:26:58.352 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-21T01:26:58.352 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-21T01:26:58.352 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-21T01:26:58.352 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:58.369 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-21T01:26:58.709 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-21T01:26:58.709 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-21T01:26:58.709 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-21T01:26:58.709 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-21T01:26:58.709 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-21T01:26:58.709 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-21T01:26:58.710 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-21T01:26:58.711 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-21T01:26:58.712 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-21T01:26:58.767 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-21T01:26:58.767 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:58.767 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:26:58.767 INFO:teuthology.orchestra.run.trial043.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: lua-5.4.4-4.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-21T01:26:58.768 INFO:teuthology.orchestra.run.trial043.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-21T01:26:58.769 INFO:teuthology.orchestra.run.trial043.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-ply-3.11-14.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-21T01:26:58.770 INFO:teuthology.orchestra.run.trial043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-21T01:26:58.771 INFO:teuthology.orchestra.run.trial043.stdout: unzip-6.0-59.el9.x86_64 2026-02-21T01:26:58.771 INFO:teuthology.orchestra.run.trial043.stdout: zip-3.0-35.el9.x86_64 2026-02-21T01:26:58.771 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:58.771 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:26:58.803 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-base 2026-02-21T01:26:59.116 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:32 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:26:59.181 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:26:59.198 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:26:59.198 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:26:59.198 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:26:59.219 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install cephadm 2026-02-21T01:26:59.522 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:32 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:26:59.606 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:26:59.606 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:59.606 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:26:59.606 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:59.606 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:26:59.607 INFO:teuthology.orchestra.run.trial043.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-21T01:26:59.607 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:59.607 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:26:59.607 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:26:59.607 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-21T01:26:59.607 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:59.607 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 1.0 M 2026-02-21T01:26:59.608 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 1.0 M 2026-02-21T01:26:59.608 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:26:59.726 INFO:teuthology.orchestra.run.trial043.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 8.3 MB/s | 1.0 MB 00:00 2026-02-21T01:26:59.726 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:26:59.726 INFO:teuthology.orchestra.run.trial043.stdout:Total 8.2 MB/s | 1.0 MB 00:00 2026-02-21T01:26:59.726 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:26:59.729 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:26:59.729 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:26:59.733 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:26:59.733 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:26:59.751 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:26:59.816 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:59.829 INFO:teuthology.orchestra.run.trial043.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:59.891 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:59.947 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-21T01:26:59.947 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:59.947 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:26:59.947 INFO:teuthology.orchestra.run.trial043.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:26:59.947 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:26:59.947 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:26:59.973 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-immutable-object-cache 2026-02-21T01:27:00.135 INFO:teuthology.orchestra.run.trial046.stdout:(12/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 1.4 MB/s | 5.3 MB 00:03 2026-02-21T01:27:00.138 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:00.138 INFO:teuthology.orchestra.run.trial046.stdout:Total 9.5 MB/s | 43 MB 00:04 2026-02-21T01:27:00.291 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:33 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:00.295 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:00.308 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:00.308 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:00.375 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:00.376 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-21T01:27:00.376 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:00.376 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 154 k 2026-02-21T01:27:00.376 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 447 k 2026-02-21T01:27:00.376 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:00.462 INFO:teuthology.orchestra.run.trial043.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 1.7 MB/s | 154 kB 00:00 2026-02-21T01:27:00.463 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:00.463 INFO:teuthology.orchestra.run.trial043.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-21T01:27:00.463 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:00.467 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:00.467 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:00.494 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:00.494 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:00.509 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:00.510 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:00.544 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:00.545 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-21T01:27:00.569 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-21T01:27:00.569 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:27:00.569 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-21T01:27:00.570 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:00.725 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:00.728 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-21T01:27:00.735 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-21T01:27:00.769 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-21T01:27:00.773 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-21T01:27:00.831 INFO:teuthology.orchestra.run.trial046.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-21T01:27:00.834 INFO:teuthology.orchestra.run.trial046.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-21T01:27:00.855 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-21T01:27:00.875 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-21T01:27:00.875 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:00.875 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:00.875 INFO:teuthology.orchestra.run.trial043.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:00.875 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:00.875 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:00.903 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr 2026-02-21T01:27:01.177 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-21T01:27:01.211 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:34 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:01.248 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-21T01:27:01.277 INFO:teuthology.orchestra.run.trial043.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:01.294 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:01.295 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:01.295 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:01.316 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-dashboard 2026-02-21T01:27:01.628 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:34 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:01.713 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-21T01:27:01.714 INFO:teuthology.orchestra.run.trial043.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout:Install 14 Packages 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 16 M 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 158 M 2026-02-21T01:27:01.715 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:01.908 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-21T01:27:02.224 INFO:teuthology.orchestra.run.trial043.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 253 kB/s | 17 kB 00:00 2026-02-21T01:27:02.228 INFO:teuthology.orchestra.run.trial043.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 588 kB/s | 43 kB 00:00 2026-02-21T01:27:02.262 INFO:teuthology.orchestra.run.trial043.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 1.4 MB/s | 48 kB 00:00 2026-02-21T01:27:02.290 INFO:teuthology.orchestra.run.trial043.stdout:(4/14): python3-protobuf-3.14.0-17.el9.noarch.r 9.6 MB/s | 267 kB 00:00 2026-02-21T01:27:02.298 INFO:teuthology.orchestra.run.trial043.stdout:(5/14): protobuf-3.14.0-17.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2026-02-21T01:27:02.322 INFO:teuthology.orchestra.run.trial043.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 26 MB/s | 862 kB 00:00 2026-02-21T01:27:02.332 INFO:teuthology.orchestra.run.trial043.stdout:(7/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 16 MB/s | 551 kB 00:00 2026-02-21T01:27:02.333 INFO:teuthology.orchestra.run.trial043.stdout:(8/14): grpc-data-1.46.7-10.el9.noarch.rpm 1.8 MB/s | 19 kB 00:00 2026-02-21T01:27:02.345 INFO:teuthology.orchestra.run.trial043.stdout:(9/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 171 MB/s | 2.0 MB 00:00 2026-02-21T01:27:02.346 INFO:teuthology.orchestra.run.trial043.stdout:(10/14): python3-grpcio-tools-1.46.7-10.el9.x86 11 MB/s | 144 kB 00:00 2026-02-21T01:27:02.349 INFO:teuthology.orchestra.run.trial043.stdout:(11/14): python3-repoze-lru-0.7-16.el9.noarch.r 9.0 MB/s | 31 kB 00:00 2026-02-21T01:27:02.349 INFO:teuthology.orchestra.run.trial043.stdout:(12/14): python3-routes-2.5.1-5.el9.noarch.rpm 49 MB/s | 188 kB 00:00 2026-02-21T01:27:02.352 INFO:teuthology.orchestra.run.trial043.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 6.4 MB/s | 22 kB 00:00 2026-02-21T01:27:02.358 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-21T01:27:02.359 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-21T01:27:02.446 INFO:teuthology.orchestra.run.trial043.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 36 MB/s | 11 MB 00:00 2026-02-21T01:27:02.448 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:02.448 INFO:teuthology.orchestra.run.trial043.stdout:Total 21 MB/s | 16 MB 00:00 2026-02-21T01:27:02.485 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:02.495 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:02.495 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:02.590 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:02.590 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-21T01:27:02.656 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-21T01:27:02.657 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-21T01:27:02.657 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-21T01:27:02.657 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-21T01:27:02.706 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:02.713 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-21T01:27:02.713 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:02.713 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:02.713 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:02.713 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-21T01:27:02.713 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-21T01:27:02.713 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:02.714 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:02.715 INFO:teuthology.orchestra.run.trial043.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-21T01:27:02.717 INFO:teuthology.orchestra.run.trial043.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-21T01:27:02.722 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-21T01:27:02.733 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-21T01:27:02.735 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-21T01:27:02.752 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-rook 2026-02-21T01:27:02.762 INFO:teuthology.orchestra.run.trial043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-21T01:27:02.806 INFO:teuthology.orchestra.run.trial043.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-21T01:27:02.835 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-21T01:27:02.844 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-21T01:27:02.851 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-21T01:27:02.854 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-21T01:27:02.861 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-21T01:27:03.055 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:03.138 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:03.139 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:03.139 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-21T01:27:03.140 INFO:teuthology.orchestra.run.trial046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout:Install 10 Packages 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 2.0 M 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 25 M 2026-02-21T01:27:03.141 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:03.623 INFO:teuthology.orchestra.run.trial046.stdout:(1/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2026-02-21T01:27:03.642 INFO:teuthology.orchestra.run.trial046.stdout:(2/10): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2026-02-21T01:27:03.654 INFO:teuthology.orchestra.run.trial046.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 1.7 MB/s | 54 kB 00:00 2026-02-21T01:27:03.856 INFO:teuthology.orchestra.run.trial046.stdout:(4/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 134 kB/s | 50 kB 00:00 2026-02-21T01:27:03.884 INFO:teuthology.orchestra.run.trial046.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2026-02-21T01:27:03.885 INFO:teuthology.orchestra.run.trial046.stdout:(6/10): python3-certifi-2023.05.07-4.el9.noarch 61 kB/s | 14 kB 00:00 2026-02-21T01:27:03.996 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-21T01:27:04.001 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-21T01:27:04.019 INFO:teuthology.orchestra.run.trial046.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 440 kB/s | 59 kB 00:00 2026-02-21T01:27:04.154 INFO:teuthology.orchestra.run.trial046.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 666 kB/s | 90 kB 00:00 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-21T01:27:04.215 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-21T01:27:04.217 INFO:teuthology.orchestra.run.trial046.stdout:(9/10): python3-kubernetes-26.1.0-3.el9.noarch. 3.1 MB/s | 1.0 MB 00:00 2026-02-21T01:27:04.256 INFO:teuthology.orchestra.run.trial046.stdout:(10/10): python3-google-auth-2.45.0-1.el9.noarc 637 kB/s | 254 kB 00:00 2026-02-21T01:27:04.256 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:04.257 INFO:teuthology.orchestra.run.trial046.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-21T01:27:04.272 INFO:teuthology.orchestra.run.trial043.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:04.273 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:04.282 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:04.290 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:04.290 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:04.303 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-21T01:27:04.330 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:04.331 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:04.404 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:04.454 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-21T01:27:04.466 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-21T01:27:04.481 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-21T01:27:04.485 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-21T01:27:04.493 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-21T01:27:04.531 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-21T01:27:04.543 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-21T01:27:04.608 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:37 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:04.691 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:04.692 INFO:teuthology.orchestra.run.trial043.stdout:====================================================================================== 2026-02-21T01:27:04.692 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:27:04.692 INFO:teuthology.orchestra.run.trial043.stdout:====================================================================================== 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-21T01:27:04.693 INFO:teuthology.orchestra.run.trial043.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout:====================================================================================== 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout:Install 12 Packages 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 43 M 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 234 M 2026-02-21T01:27:04.694 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:04.855 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-21T01:27:04.869 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-21T01:27:04.870 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-21T01:27:04.894 INFO:teuthology.orchestra.run.trial043.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 4.0 MB/s | 184 kB 00:00 2026-02-21T01:27:04.912 INFO:teuthology.orchestra.run.trial043.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 12 MB/s | 794 kB 00:00 2026-02-21T01:27:04.978 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-21T01:27:04.978 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-21T01:27:04.978 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-21T01:27:04.978 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-21T01:27:04.978 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-21T01:27:04.979 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-21T01:27:04.979 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-21T01:27:04.979 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-21T01:27:04.979 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-21T01:27:04.979 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:05.034 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:05.065 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-cephadm 2026-02-21T01:27:05.322 INFO:teuthology.orchestra.run.trial043.stdout:(3/12): ceph-mgr-diskprediction-local-20.2.0-68 16 MB/s | 7.4 MB 00:00 2026-02-21T01:27:05.367 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:41 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:05.405 INFO:teuthology.orchestra.run.trial043.stdout:(4/12): flexiblas-3.0.4-9.el9.x86_64.rpm 58 kB/s | 30 kB 00:00 2026-02-21T01:27:05.449 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:05.450 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:05.450 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:27:05.450 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:05.450 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:05.450 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout:Install 7 Packages 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 7.1 M 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 33 M 2026-02-21T01:27:05.451 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:05.582 INFO:teuthology.orchestra.run.trial043.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 238 kB/s | 42 kB 00:00 2026-02-21T01:27:05.695 INFO:teuthology.orchestra.run.trial046.stdout:(1/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 1.6 MB/s | 173 kB 00:00 2026-02-21T01:27:05.739 INFO:teuthology.orchestra.run.trial043.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 36 kB/s | 15 kB 00:00 2026-02-21T01:27:05.962 INFO:teuthology.orchestra.run.trial046.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 130 kB/s | 35 kB 00:00 2026-02-21T01:27:06.043 INFO:teuthology.orchestra.run.trial043.stdout:(7/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2026-02-21T01:27:06.102 INFO:teuthology.orchestra.run.trial046.stdout:(3/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 487 kB/s | 249 kB 00:00 2026-02-21T01:27:06.150 INFO:teuthology.orchestra.run.trial043.stdout:(8/12): python3-devel-3.9.25-3.el9.x86_64.rpm 595 kB/s | 244 kB 00:00 2026-02-21T01:27:06.381 INFO:teuthology.orchestra.run.trial046.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 207 kB/s | 58 kB 00:00 2026-02-21T01:27:06.453 INFO:teuthology.orchestra.run.trial046.stdout:(5/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2026-02-21T01:27:06.469 INFO:teuthology.orchestra.run.trial046.stdout:(6/7): python3-babel-2.9.1-2.el9.noarch.rpm 6.8 MB/s | 6.0 MB 00:00 2026-02-21T01:27:06.523 INFO:teuthology.orchestra.run.trial046.stdout:(7/7): python3-typing-extensions-4.15.0-1.el9.n 611 kB/s | 86 kB 00:00 2026-02-21T01:27:06.523 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:06.523 INFO:teuthology.orchestra.run.trial046.stdout:Total 6.6 MB/s | 7.1 MB 00:01 2026-02-21T01:27:06.560 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:06.566 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:06.566 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:06.637 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:06.638 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:06.718 INFO:teuthology.orchestra.run.trial043.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 779 kB/s | 442 kB 00:00 2026-02-21T01:27:06.725 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:06.773 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-21T01:27:06.783 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-21T01:27:06.789 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-21T01:27:06.940 INFO:teuthology.orchestra.run.trial043.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 6.8 MB/s | 6.1 MB 00:00 2026-02-21T01:27:07.008 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-21T01:27:07.031 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-21T01:27:07.055 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-21T01:27:07.056 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-21T01:27:07.163 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-21T01:27:07.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-21T01:27:07.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-21T01:27:07.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-21T01:27:07.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-21T01:27:07.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-21T01:27:07.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-21T01:27:07.220 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-21T01:27:07.220 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:07.220 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:07.220 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:07.220 INFO:teuthology.orchestra.run.trial046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-21T01:27:07.220 INFO:teuthology.orchestra.run.trial046.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-21T01:27:07.220 INFO:teuthology.orchestra.run.trial046.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-21T01:27:07.221 INFO:teuthology.orchestra.run.trial046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-21T01:27:07.221 INFO:teuthology.orchestra.run.trial046.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-21T01:27:07.221 INFO:teuthology.orchestra.run.trial046.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-21T01:27:07.221 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:07.221 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:07.250 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-fuse 2026-02-21T01:27:07.327 INFO:teuthology.orchestra.run.trial043.stdout:(11/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 3.0 MB/s | 5.3 MB 00:01 2026-02-21T01:27:07.551 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:43 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:07.633 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-21T01:27:07.634 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:07.634 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 942 k 2026-02-21T01:27:07.634 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 2.7 M 2026-02-21T01:27:07.634 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:07.756 INFO:teuthology.orchestra.run.trial046.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 7.5 MB/s | 942 kB 00:00 2026-02-21T01:27:07.757 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:07.757 INFO:teuthology.orchestra.run.trial046.stdout:Total 7.5 MB/s | 942 kB 00:00 2026-02-21T01:27:07.757 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:07.761 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:07.761 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:07.795 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:07.795 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:07.883 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:07.901 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:08.110 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:08.166 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:08.166 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:08.166 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:08.166 INFO:teuthology.orchestra.run.trial046.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:08.166 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:08.166 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:08.193 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-volume 2026-02-21T01:27:08.418 INFO:teuthology.orchestra.run.trial043.stdout:(12/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 11 MB/s | 19 MB 00:01 2026-02-21T01:27:08.420 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:08.420 INFO:teuthology.orchestra.run.trial043.stdout:Total 11 MB/s | 43 MB 00:03 2026-02-21T01:27:08.498 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:44 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:08.576 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:08.580 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:08.581 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:08.581 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-21T01:27:08.581 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:08.581 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:08.581 INFO:teuthology.orchestra.run.trial046.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-21T01:27:08.581 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout:Install 2 Packages 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 648 k 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 2.2 M 2026-02-21T01:27:08.582 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:08.589 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:08.589 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:08.738 INFO:teuthology.orchestra.run.trial046.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 3.0 MB/s | 297 kB 00:00 2026-02-21T01:27:08.791 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:08.791 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:08.791 INFO:teuthology.orchestra.run.trial046.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.3 MB/s | 351 kB 00:00 2026-02-21T01:27:08.792 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:08.792 INFO:teuthology.orchestra.run.trial046.stdout:Total 3.0 MB/s | 648 kB 00:00 2026-02-21T01:27:08.802 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:08.809 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:08.809 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:08.853 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:08.853 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:08.931 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:08.992 INFO:teuthology.orchestra.run.trial046.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-21T01:27:08.994 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-21T01:27:09.007 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:09.009 INFO:teuthology.orchestra.run.trial043.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-21T01:27:09.010 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-21T01:27:09.010 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:27:09.010 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-21T01:27:09.010 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:09.015 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-21T01:27:09.049 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-21T01:27:09.054 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-21T01:27:09.113 INFO:teuthology.orchestra.run.trial043.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-21T01:27:09.115 INFO:teuthology.orchestra.run.trial043.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-21T01:27:09.137 INFO:teuthology.orchestra.run.trial043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-21T01:27:09.230 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-21T01:27:09.288 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-21T01:27:09.288 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:09.288 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:09.288 INFO:teuthology.orchestra.run.trial046.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-21T01:27:09.288 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:09.288 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:09.316 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados-devel 2026-02-21T01:27:09.466 INFO:teuthology.orchestra.run.trial043.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-21T01:27:09.541 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-21T01:27:09.619 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:45 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:09.705 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:09.705 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:09.705 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-21T01:27:09.705 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:09.705 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:09.705 INFO:teuthology.orchestra.run.trial046.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-21T01:27:09.705 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:09.706 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:09.706 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:09.706 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-21T01:27:09.706 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:09.706 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 126 k 2026-02-21T01:27:09.706 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 449 k 2026-02-21T01:27:09.706 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:10.172 INFO:teuthology.orchestra.run.trial046.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 269 kB/s | 126 kB 00:00 2026-02-21T01:27:10.173 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:10.173 INFO:teuthology.orchestra.run.trial046.stdout:Total 269 kB/s | 126 kB 00:00 2026-02-21T01:27:10.173 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:10.176 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:10.176 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:10.207 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:10.207 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:10.221 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-21T01:27:10.260 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:10.276 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:10.353 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:10.411 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:10.411 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:10.411 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:10.411 INFO:teuthology.orchestra.run.trial046.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:10.411 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:10.411 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:10.437 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs2 2026-02-21T01:27:10.679 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-21T01:27:10.680 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-21T01:27:10.747 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:46 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:10.813 INFO:teuthology.orchestra.run.trial046.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:10.831 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:10.831 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:27:10.831 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:10.853 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs-devel 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-21T01:27:10.967 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-21T01:27:11.026 INFO:teuthology.orchestra.run.trial043.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:11.027 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:11.064 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-rook 2026-02-21T01:27:11.162 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:47 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:11.245 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:11.246 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:11.246 INFO:teuthology.orchestra.run.trial046.stdout:Install 2 Packages 2026-02-21T01:27:11.246 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:11.246 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 58 k 2026-02-21T01:27:11.246 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 207 k 2026-02-21T01:27:11.246 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:11.309 INFO:teuthology.orchestra.run.trial046.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 543 kB/s | 34 kB 00:00 2026-02-21T01:27:11.312 INFO:teuthology.orchestra.run.trial046.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 368 kB/s | 24 kB 00:00 2026-02-21T01:27:11.313 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:11.313 INFO:teuthology.orchestra.run.trial046.stdout:Total 860 kB/s | 58 kB 00:00 2026-02-21T01:27:11.314 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:11.316 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:11.316 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:11.348 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:11.348 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:11.373 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:44 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:11.396 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:11.397 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-21T01:27:11.412 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-21T01:27:11.429 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-21T01:27:11.457 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:11.458 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:11.458 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:27:11.458 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-21T01:27:11.459 INFO:teuthology.orchestra.run.trial043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout:Install 10 Packages 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 2.0 M 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 25 M 2026-02-21T01:27:11.460 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:11.485 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-21T01:27:11.485 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-21T01:27:11.541 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-21T01:27:11.542 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:11.542 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:11.542 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:11.542 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:11.542 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:11.542 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:11.568 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados2 2026-02-21T01:27:11.875 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:47 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:11.890 INFO:teuthology.orchestra.run.trial043.stdout:(1/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 159 kB 00:00 2026-02-21T01:27:11.898 INFO:teuthology.orchestra.run.trial043.stdout:(2/10): python3-pyasn1-modules-0.4.8-6.el9.noar 4.7 MB/s | 279 kB 00:00 2026-02-21T01:27:11.901 INFO:teuthology.orchestra.run.trial043.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 4.6 MB/s | 54 kB 00:00 2026-02-21T01:27:11.914 INFO:teuthology.orchestra.run.trial043.stdout:(4/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 684 kB/s | 50 kB 00:00 2026-02-21T01:27:11.928 INFO:teuthology.orchestra.run.trial043.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 531 kB/s | 14 kB 00:00 2026-02-21T01:27:11.931 INFO:teuthology.orchestra.run.trial043.stdout:(6/10): python3-cachetools-4.2.4-1.el9.noarch.r 983 kB/s | 32 kB 00:00 2026-02-21T01:27:11.938 INFO:teuthology.orchestra.run.trial043.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 8.8 MB/s | 59 kB 00:00 2026-02-21T01:27:11.941 INFO:teuthology.orchestra.run.trial046.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:11.945 INFO:teuthology.orchestra.run.trial043.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 13 MB/s | 90 kB 00:00 2026-02-21T01:27:11.951 INFO:teuthology.orchestra.run.trial043.stdout:(9/10): python3-google-auth-2.45.0-1.el9.noarch 6.7 MB/s | 254 kB 00:00 2026-02-21T01:27:11.959 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:11.960 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:27:11.960 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:11.976 INFO:teuthology.orchestra.run.trial043.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 21 MB/s | 1.0 MB 00:00 2026-02-21T01:27:11.979 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:11.980 INFO:teuthology.orchestra.run.trial043.stdout:Total 3.8 MB/s | 2.0 MB 00:00 2026-02-21T01:27:11.981 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librbd1 2026-02-21T01:27:12.005 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:12.013 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:12.013 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:12.052 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:12.053 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:12.126 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:12.175 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-21T01:27:12.187 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-21T01:27:12.201 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-21T01:27:12.206 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-21T01:27:12.213 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-21T01:27:12.252 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-21T01:27:12.264 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-21T01:27:12.288 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:48 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:12.353 INFO:teuthology.orchestra.run.trial046.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:12.371 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:12.371 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:27:12.371 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:12.392 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rados 2026-02-21T01:27:12.576 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-21T01:27:12.590 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-21T01:27:12.591 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-21T01:27:12.695 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:48 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:12.698 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-21T01:27:12.698 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-21T01:27:12.698 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-21T01:27:12.698 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-21T01:27:12.698 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-21T01:27:12.698 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-21T01:27:12.698 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-21T01:27:12.699 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-21T01:27:12.699 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-21T01:27:12.699 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-21T01:27:12.755 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-21T01:27:12.755 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:12.755 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:12.755 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:12.756 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:12.760 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:12.778 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:12.778 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:27:12.778 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:12.785 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-mgr-cephadm 2026-02-21T01:27:12.800 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rgw 2026-02-21T01:27:13.096 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:46 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:13.110 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:49 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:13.176 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:13.180 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:13.180 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:13.180 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:27:13.180 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:13.180 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:13.180 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-21T01:27:13.180 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout:Install 7 Packages 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 7.1 M 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 33 M 2026-02-21T01:27:13.181 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:13.194 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:13.194 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:27:13.194 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:13.215 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-cephfs 2026-02-21T01:27:13.520 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:49 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:13.585 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:13.603 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:13.603 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:27:13.604 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:13.625 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rbd 2026-02-21T01:27:13.698 INFO:teuthology.orchestra.run.trial043.stdout:(1/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 2.0 MB/s | 173 kB 00:00 2026-02-21T01:27:13.932 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:49 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:13.997 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:14.015 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:14.016 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-21T01:27:14.016 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:14.037 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-fuse 2026-02-21T01:27:14.259 INFO:teuthology.orchestra.run.trial043.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 62 kB/s | 35 kB 00:00 2026-02-21T01:27:14.347 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:50 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:14.414 INFO:teuthology.orchestra.run.trial043.stdout:(3/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 310 kB/s | 249 kB 00:00 2026-02-21T01:27:14.430 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:14.431 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:14.431 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-21T01:27:14.431 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:14.431 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:14.431 INFO:teuthology.orchestra.run.trial046.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-21T01:27:14.431 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:14.431 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:14.432 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:14.432 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-21T01:27:14.432 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:14.432 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 91 k 2026-02-21T01:27:14.432 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 238 k 2026-02-21T01:27:14.432 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:14.541 INFO:teuthology.orchestra.run.trial043.stdout:(4/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.9 MB/s | 548 kB 00:00 2026-02-21T01:27:14.575 INFO:teuthology.orchestra.run.trial043.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 358 kB/s | 58 kB 00:00 2026-02-21T01:27:14.584 INFO:teuthology.orchestra.run.trial043.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 2.0 MB/s | 86 kB 00:00 2026-02-21T01:27:16.697 INFO:teuthology.orchestra.run.trial046.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 40 kB/s | 91 kB 00:02 2026-02-21T01:27:16.697 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:16.697 INFO:teuthology.orchestra.run.trial046.stdout:Total 40 kB/s | 91 kB 00:02 2026-02-21T01:27:16.697 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:16.701 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:16.701 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:16.731 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:16.731 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:16.782 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:16.798 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:16.879 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:16.937 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:16.937 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:16.937 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:16.937 INFO:teuthology.orchestra.run.trial046.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:16.937 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:16.938 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:16.965 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-mirror 2026-02-21T01:27:17.281 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:17.365 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:17.366 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:17.366 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-21T01:27:17.366 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:17.366 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 2.9 M 2026-02-21T01:27:17.366 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 11 M 2026-02-21T01:27:17.366 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:18.160 INFO:teuthology.orchestra.run.trial046.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 3.7 MB/s | 2.9 MB 00:00 2026-02-21T01:27:18.160 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:18.160 INFO:teuthology.orchestra.run.trial046.stdout:Total 3.7 MB/s | 2.9 MB 00:00 2026-02-21T01:27:18.161 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:18.165 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:18.165 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:18.204 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:18.204 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:18.392 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:18.394 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:18.417 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:18.418 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:27:18.418 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-21T01:27:18.418 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-21T01:27:18.418 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-21T01:27:18.418 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:18.739 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:18.740 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:18.740 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:18.740 INFO:teuthology.orchestra.run.trial046.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:18.740 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:18.740 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:18.769 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-nbd 2026-02-21T01:27:18.817 INFO:teuthology.orchestra.run.trial043.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 1.1 MB/s | 6.0 MB 00:05 2026-02-21T01:27:18.819 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:18.819 INFO:teuthology.orchestra.run.trial043.stdout:Total 1.3 MB/s | 7.1 MB 00:05 2026-02-21T01:27:18.857 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:18.863 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:18.864 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:18.935 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:18.935 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:19.025 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:19.075 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-21T01:27:19.077 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Feb 2026 01:26:24 AM UTC. 2026-02-21T01:27:19.084 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-21T01:27:19.090 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 180 k 2026-02-21T01:27:19.161 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 498 k 2026-02-21T01:27:19.162 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-21T01:27:19.248 INFO:teuthology.orchestra.run.trial046.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 2.0 MB/s | 180 kB 00:00 2026-02-21T01:27:19.248 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:19.248 INFO:teuthology.orchestra.run.trial046.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-21T01:27:19.248 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-21T01:27:19.252 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-21T01:27:19.252 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-21T01:27:19.283 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-21T01:27:19.283 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-21T01:27:19.310 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-21T01:27:19.333 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-21T01:27:19.338 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-21T01:27:19.355 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:19.357 INFO:teuthology.orchestra.run.trial043.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-21T01:27:19.358 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-21T01:27:19.432 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:19.468 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-21T01:27:19.468 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-21T01:27:19.468 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-21T01:27:19.468 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-21T01:27:19.469 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-21T01:27:19.469 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-21T01:27:19.469 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-21T01:27:19.490 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:19.490 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:19.490 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-21T01:27:19.490 INFO:teuthology.orchestra.run.trial046.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:19.490 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:19.490 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-21T01:27:19.526 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:19.526 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-21T01:27:19.526 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-21T01:27:19.527 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:19.528 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:19.555 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-fuse 2026-02-21T01:27:19.870 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:19.955 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:19.955 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:19.955 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-21T01:27:19.955 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:19.955 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 942 k 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 2.7 M 2026-02-21T01:27:19.956 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:20.110 INFO:teuthology.orchestra.run.trial043.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 5.9 MB/s | 942 kB 00:00 2026-02-21T01:27:20.111 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:20.111 INFO:teuthology.orchestra.run.trial043.stdout:Total 5.9 MB/s | 942 kB 00:00 2026-02-21T01:27:20.112 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:20.116 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:20.116 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:20.150 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:20.150 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:20.239 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:20.256 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:20.466 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:20.523 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:20.523 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:20.523 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:20.523 INFO:teuthology.orchestra.run.trial043.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:20.523 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:20.523 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:20.550 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install ceph-volume 2026-02-21T01:27:20.855 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:20.938 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repository Size 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:Install 2 Packages 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 648 k 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 2.2 M 2026-02-21T01:27:20.939 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:21.649 INFO:teuthology.orchestra.run.trial043.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 675 kB/s | 297 kB 00:00 2026-02-21T01:27:22.041 INFO:teuthology.orchestra.run.trial043.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 422 kB/s | 351 kB 00:00 2026-02-21T01:27:22.041 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:22.041 INFO:teuthology.orchestra.run.trial043.stdout:Total 588 kB/s | 648 kB 00:01 2026-02-21T01:27:22.051 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:22.057 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:22.057 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:22.100 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:22.100 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:22.178 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:22.241 INFO:teuthology.orchestra.run.trial043.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-21T01:27:22.243 INFO:teuthology.orchestra.run.trial043.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-21T01:27:22.257 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-21T01:27:22.257 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:27:22.257 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-21T01:27:22.257 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:22.481 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-21T01:27:22.539 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-21T01:27:22.539 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:22.539 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:22.539 INFO:teuthology.orchestra.run.trial043.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-21T01:27:22.539 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:22.540 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:22.568 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install librados-devel 2026-02-21T01:27:22.881 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:22.965 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:22.966 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:22.966 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-21T01:27:22.966 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 126 k 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 449 k 2026-02-21T01:27:22.967 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:23.299 INFO:teuthology.orchestra.run.trial043.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 379 kB/s | 126 kB 00:00 2026-02-21T01:27:23.299 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:23.299 INFO:teuthology.orchestra.run.trial043.stdout:Total 378 kB/s | 126 kB 00:00 2026-02-21T01:27:23.299 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:23.302 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:23.302 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:23.332 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:23.333 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:23.387 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:23.403 INFO:teuthology.orchestra.run.trial043.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:23.488 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:23.546 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:23.546 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:23.546 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:23.546 INFO:teuthology.orchestra.run.trial043.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:23.546 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:23.546 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:23.574 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install libcephfs2 2026-02-21T01:27:23.885 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:23.949 INFO:teuthology.orchestra.run.trial043.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:23.968 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:23.969 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:23.969 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:23.990 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install libcephfs-devel 2026-02-21T01:27:24.296 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:24.382 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:24.382 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:24.382 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-21T01:27:24.382 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:24.382 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:24.382 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-21T01:27:24.382 INFO:teuthology.orchestra.run.trial043.stdout:Installing dependencies: 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout:Install 2 Packages 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 58 k 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 207 k 2026-02-21T01:27:24.383 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:24.593 INFO:teuthology.orchestra.run.trial043.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 163 kB/s | 34 kB 00:00 2026-02-21T01:27:24.597 INFO:teuthology.orchestra.run.trial043.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 112 kB/s | 24 kB 00:00 2026-02-21T01:27:24.597 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:24.598 INFO:teuthology.orchestra.run.trial043.stdout:Total 271 kB/s | 58 kB 00:00 2026-02-21T01:27:24.598 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:24.601 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:24.601 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:24.633 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:24.633 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:24.682 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:24.682 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-21T01:27:24.696 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-21T01:27:24.712 INFO:teuthology.orchestra.run.trial043.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-21T01:27:24.770 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-21T01:27:24.771 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-21T01:27:24.828 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-21T01:27:24.828 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:24.828 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:24.828 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:24.828 INFO:teuthology.orchestra.run.trial043.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:24.828 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:24.828 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:24.854 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install librados2 2026-02-21T01:27:25.161 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:25.227 INFO:teuthology.orchestra.run.trial043.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:25.245 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:25.246 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:25.246 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:25.268 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install librbd1 2026-02-21T01:27:25.577 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:25.642 INFO:teuthology.orchestra.run.trial043.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:25.660 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:25.661 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:25.661 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:25.682 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-rados 2026-02-21T01:27:25.994 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:26.060 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:26.079 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:26.079 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:26.079 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:26.101 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-rgw 2026-02-21T01:27:26.410 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:26.476 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:26.494 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:26.495 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:26.495 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:26.516 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-cephfs 2026-02-21T01:27:26.828 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:26.894 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:26.913 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:26.914 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:26.914 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:26.935 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install python3-rbd 2026-02-21T01:27:27.243 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:27.308 INFO:teuthology.orchestra.run.trial043.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-21T01:27:27.326 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:27.326 INFO:teuthology.orchestra.run.trial043.stdout:Nothing to do. 2026-02-21T01:27:27.326 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:27.347 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install rbd-fuse 2026-02-21T01:27:27.661 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:27.745 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:27.746 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:27.746 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-21T01:27:27.746 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:27.746 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:27.746 INFO:teuthology.orchestra.run.trial043.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-21T01:27:27.746 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:27.746 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:27.747 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:27.747 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-21T01:27:27.747 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:27.747 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 91 k 2026-02-21T01:27:27.747 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 238 k 2026-02-21T01:27:27.747 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:27.928 INFO:teuthology.orchestra.run.trial043.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 501 kB/s | 91 kB 00:00 2026-02-21T01:27:27.929 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:27.929 INFO:teuthology.orchestra.run.trial043.stdout:Total 498 kB/s | 91 kB 00:00 2026-02-21T01:27:27.929 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:27.933 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:27.933 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:27.965 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:27.965 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:28.016 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:28.033 INFO:teuthology.orchestra.run.trial043.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:28.114 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:28.173 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:28.173 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:28.173 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:28.173 INFO:teuthology.orchestra.run.trial043.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:28.173 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:28.174 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:28.201 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install rbd-mirror 2026-02-21T01:27:28.517 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:28.600 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:28.600 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:28.600 INFO:teuthology.orchestra.run.trial043.stdout: Package Arch Version Repo Size 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 2.9 M 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 11 M 2026-02-21T01:27:28.601 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:28.749 INFO:teuthology.orchestra.run.trial043.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-21T01:27:28.749 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:28.750 INFO:teuthology.orchestra.run.trial043.stdout:Total 19 MB/s | 2.9 MB 00:00 2026-02-21T01:27:28.750 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:28.755 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:28.755 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:28.793 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:28.794 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:28.973 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:28.974 INFO:teuthology.orchestra.run.trial043.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:28.997 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:28.997 INFO:teuthology.orchestra.run.trial043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-21T01:27:28.997 INFO:teuthology.orchestra.run.trial043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-21T01:27:28.997 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-21T01:27:28.997 INFO:teuthology.orchestra.run.trial043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-21T01:27:28.997 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:29.327 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:29.327 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:29.328 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:29.328 INFO:teuthology.orchestra.run.trial043.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:29.328 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:29.328 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:29.355 DEBUG:teuthology.orchestra.run.trial043:> sudo yum -y install rbd-nbd 2026-02-21T01:27:29.667 INFO:teuthology.orchestra.run.trial043.stdout:Last metadata expiration check: 0:01:02 ago on Sat 21 Feb 2026 01:26:27 AM UTC. 2026-02-21T01:27:29.751 INFO:teuthology.orchestra.run.trial043.stdout:Dependencies resolved. 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout: Package Architecture Version Repository Size 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:Installing: 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:Transaction Summary 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:================================================================================ 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:Install 1 Package 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:Total download size: 180 k 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:Installed size: 498 k 2026-02-21T01:27:29.752 INFO:teuthology.orchestra.run.trial043.stdout:Downloading Packages: 2026-02-21T01:27:29.865 INFO:teuthology.orchestra.run.trial043.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.6 MB/s | 180 kB 00:00 2026-02-21T01:27:29.866 INFO:teuthology.orchestra.run.trial043.stdout:-------------------------------------------------------------------------------- 2026-02-21T01:27:29.866 INFO:teuthology.orchestra.run.trial043.stdout:Total 1.5 MB/s | 180 kB 00:00 2026-02-21T01:27:29.866 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction check 2026-02-21T01:27:29.870 INFO:teuthology.orchestra.run.trial043.stdout:Transaction check succeeded. 2026-02-21T01:27:29.870 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction test 2026-02-21T01:27:29.902 INFO:teuthology.orchestra.run.trial043.stdout:Transaction test succeeded. 2026-02-21T01:27:29.902 INFO:teuthology.orchestra.run.trial043.stdout:Running transaction 2026-02-21T01:27:29.958 INFO:teuthology.orchestra.run.trial043.stdout: Preparing : 1/1 2026-02-21T01:27:29.975 INFO:teuthology.orchestra.run.trial043.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:30.055 INFO:teuthology.orchestra.run.trial043.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:30.113 INFO:teuthology.orchestra.run.trial043.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-21T01:27:30.114 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:30.114 INFO:teuthology.orchestra.run.trial043.stdout:Installed: 2026-02-21T01:27:30.114 INFO:teuthology.orchestra.run.trial043.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-21T01:27:30.114 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:30.114 INFO:teuthology.orchestra.run.trial043.stdout:Complete! 2026-02-21T01:27:30.144 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:30.144 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-21T01:27:30.284 DEBUG:teuthology.orchestra.run.trial043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-21T01:27:30.305 INFO:teuthology.orchestra.run.trial043.stdout:20.2.0-681.g36d388f2.el9 2026-02-21T01:27:30.306 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-21T01:27:30.306 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-21T01:27:30.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-21T01:27:30.452 DEBUG:teuthology.orchestra.run.trial046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-21T01:27:30.473 INFO:teuthology.orchestra.run.trial046.stdout:20.2.0-681.g36d388f2.el9 2026-02-21T01:27:30.473 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-21T01:27:30.473 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-21T01:27:30.474 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-21T01:27:30.474 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:30.475 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-21T01:27:30.501 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:30.501 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-21T01:27:30.540 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-21T01:27:30.540 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:30.540 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/usr/bin/daemon-helper 2026-02-21T01:27:30.564 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-21T01:27:30.628 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:30.629 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/daemon-helper 2026-02-21T01:27:30.654 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-21T01:27:30.719 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-21T01:27:30.719 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:30.719 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-21T01:27:30.744 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-21T01:27:30.808 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:30.809 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-21T01:27:30.833 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-21T01:27:30.899 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-21T01:27:30.899 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:30.899 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/usr/bin/stdin-killer 2026-02-21T01:27:30.925 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-21T01:27:30.991 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:30.992 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/stdin-killer 2026-02-21T01:27:31.017 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-21T01:27:31.081 INFO:teuthology.run_tasks:Running task ceph... 2026-02-21T01:27:31.192 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-21T01:27:31.192 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod 777 /var/log/ceph 2026-02-21T01:27:31.194 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 777 /var/log/ceph 2026-02-21T01:27:31.218 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-21T01:27:31.218 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-21T01:27:31.259 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-21T01:27:31.283 INFO:tasks.ceph:Creating extra log directories... 2026-02-21T01:27:31.283 DEBUG:teuthology.orchestra.run.trial043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-21T01:27:31.322 DEBUG:teuthology.orchestra.run.trial046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-21T01:27:31.355 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-21T01:27:31.355 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-21T01:27:31.355 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184', 'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{bitmap} base mem$/{normal-1} onode-segment$/{none} write$/{v1/{compr$/{no$/{no}} v1}}}} rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/rados_api_tests}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '62184', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'mon_bind_msgr2': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 6877, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'targets': {'trial043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpJi8jW38DMMWNnEOuvQXC/7cdtrsuEQsyDXnbh4esuQOnrYFzh1zGrUlP14G9pDYZysX2kiRRsaOvQIUsV63c=', 'trial046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ0b32S60LaKjrmPn6Exx1tXYKLq6tl0nZqauEW/yF+aTjwpCk3Ye4D2hXz5nGcVsNXtA45MpbV0toiGhwgoXZM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1, 'thrash_many': True}}, {'workunit': {'clients': {'client.0': ['rados/test.sh unit_test_scan']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-21_00:21:18', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-21T01:27:31.355 DEBUG:teuthology.orchestra.run.trial043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-21T01:27:31.385 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-21T01:27:31.403 DEBUG:teuthology.orchestra.run.trial043:> sudo install -d -m0777 -- /var/run/ceph 2026-02-21T01:27:31.443 DEBUG:teuthology.orchestra.run.trial046:> sudo install -d -m0777 -- /var/run/ceph 2026-02-21T01:27:31.467 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:31.467 DEBUG:teuthology.orchestra.run.trial043:> dd if=/scratch_devs of=/dev/stdout 2026-02-21T01:27:31.522 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-21T01:27:31.522 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_1 2026-02-21T01:27:31.578 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-21T01:27:31.578 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:31.578 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 916 Links: 1 2026-02-21T01:27:31.579 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:31.579 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:31.579 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-21 01:27:29.156320875 +0000 2026-02-21T01:27:31.579 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-21 01:26:03.249220458 +0000 2026-02-21T01:27:31.579 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-21 01:26:03.249220458 +0000 2026-02-21T01:27:31.579 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-21 01:26:03.249220458 +0000 2026-02-21T01:27:31.579 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-21T01:27:31.641 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-21T01:27:31.641 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-21T01:27:31.642 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000174588 s, 2.9 MB/s 2026-02-21T01:27:31.643 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-21T01:27:31.699 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_2 2026-02-21T01:27:31.757 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-21T01:27:31.757 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:31.758 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 942 Links: 1 2026-02-21T01:27:31.758 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:31.758 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:31.758 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-21 01:27:29.156320875 +0000 2026-02-21T01:27:31.758 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-21 01:26:03.470212476 +0000 2026-02-21T01:27:31.758 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-21 01:26:03.470212476 +0000 2026-02-21T01:27:31.758 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-21 01:26:03.470212476 +0000 2026-02-21T01:27:31.759 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-21T01:27:31.820 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-21T01:27:31.821 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-21T01:27:31.821 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000143301 s, 3.6 MB/s 2026-02-21T01:27:31.822 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-21T01:27:31.881 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_3 2026-02-21T01:27:31.939 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-21T01:27:31.939 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:31.939 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 970 Links: 1 2026-02-21T01:27:31.939 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:31.939 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:31.939 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-21 01:27:29.156320875 +0000 2026-02-21T01:27:31.940 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-21 01:26:03.734202941 +0000 2026-02-21T01:27:31.940 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-21 01:26:03.734202941 +0000 2026-02-21T01:27:31.940 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-21 01:26:03.734202941 +0000 2026-02-21T01:27:31.940 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-21T01:27:32.001 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-21T01:27:32.001 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-21T01:27:32.001 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000144974 s, 3.5 MB/s 2026-02-21T01:27:32.002 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-21T01:27:32.058 DEBUG:teuthology.orchestra.run.trial043:> stat /dev/vg_nvme/lv_4 2026-02-21T01:27:32.114 INFO:teuthology.orchestra.run.trial043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-21T01:27:32.114 INFO:teuthology.orchestra.run.trial043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:32.114 INFO:teuthology.orchestra.run.trial043.stdout:Device: 6h/6d Inode: 1000 Links: 1 2026-02-21T01:27:32.114 INFO:teuthology.orchestra.run.trial043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:32.114 INFO:teuthology.orchestra.run.trial043.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:32.114 INFO:teuthology.orchestra.run.trial043.stdout:Access: 2026-02-21 01:27:29.157320806 +0000 2026-02-21T01:27:32.115 INFO:teuthology.orchestra.run.trial043.stdout:Modify: 2026-02-21 01:26:04.004193190 +0000 2026-02-21T01:27:32.115 INFO:teuthology.orchestra.run.trial043.stdout:Change: 2026-02-21 01:26:04.004193190 +0000 2026-02-21T01:27:32.115 INFO:teuthology.orchestra.run.trial043.stdout: Birth: 2026-02-21 01:26:04.004193190 +0000 2026-02-21T01:27:32.115 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-21T01:27:32.175 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records in 2026-02-21T01:27:32.176 INFO:teuthology.orchestra.run.trial043.stderr:1+0 records out 2026-02-21T01:27:32.176 INFO:teuthology.orchestra.run.trial043.stderr:512 bytes copied, 0.000144263 s, 3.5 MB/s 2026-02-21T01:27:32.177 DEBUG:teuthology.orchestra.run.trial043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-21T01:27:32.234 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:32.234 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:32.234 DEBUG:teuthology.orchestra.run.trial046:> dd if=/scratch_devs of=/dev/stdout 2026-02-21T01:27:32.253 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-21T01:27:32.253 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_1 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 907 Links: 1 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-21 01:27:18.558252380 +0000 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-21 01:26:00.795353392 +0000 2026-02-21T01:27:32.311 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-21 01:26:00.795353392 +0000 2026-02-21T01:27:32.312 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-21 01:26:00.795353392 +0000 2026-02-21T01:27:32.312 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-21T01:27:32.376 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-21T01:27:32.376 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-21T01:27:32.376 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000149927 s, 3.4 MB/s 2026-02-21T01:27:32.378 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-21T01:27:32.434 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_2 2026-02-21T01:27:32.491 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-21T01:27:32.491 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:32.492 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 939 Links: 1 2026-02-21T01:27:32.492 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:32.492 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:32.492 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-21 01:27:18.558252380 +0000 2026-02-21T01:27:32.492 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-21 01:26:01.011348363 +0000 2026-02-21T01:27:32.492 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-21 01:26:01.011348363 +0000 2026-02-21T01:27:32.492 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-21 01:26:01.011348363 +0000 2026-02-21T01:27:32.493 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-21T01:27:32.554 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-21T01:27:32.554 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-21T01:27:32.554 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000147543 s, 3.5 MB/s 2026-02-21T01:27:32.555 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-21T01:27:32.612 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_3 2026-02-21T01:27:32.668 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 963 Links: 1 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-21 01:27:18.559252358 +0000 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-21 01:26:01.248342845 +0000 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-21 01:26:01.248342845 +0000 2026-02-21T01:27:32.669 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-21 01:26:01.248342845 +0000 2026-02-21T01:27:32.669 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-21T01:27:32.732 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-21T01:27:32.732 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-21T01:27:32.732 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000162501 s, 3.2 MB/s 2026-02-21T01:27:32.733 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-21T01:27:32.791 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_4 2026-02-21T01:27:32.848 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-21T01:27:32.848 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-21T01:27:32.848 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 993 Links: 1 2026-02-21T01:27:32.848 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-21T01:27:32.848 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-21T01:27:32.848 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-21 01:27:18.559252358 +0000 2026-02-21T01:27:32.848 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-21 01:26:01.497337048 +0000 2026-02-21T01:27:32.849 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-21 01:26:01.497337048 +0000 2026-02-21T01:27:32.849 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-21 01:26:01.497337048 +0000 2026-02-21T01:27:32.849 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-21T01:27:32.910 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-21T01:27:32.910 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-21T01:27:32.910 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000145039 s, 3.5 MB/s 2026-02-21T01:27:32.912 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-21T01:27:32.971 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:32.971 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial046.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-21T01:27:32.971 INFO:tasks.ceph:Generating config... 2026-02-21T01:27:32.972 INFO:tasks.ceph:[client] debug monc = 20 2026-02-21T01:27:32.972 INFO:tasks.ceph:[client] debug ms = 1 2026-02-21T01:27:32.972 INFO:tasks.ceph:[global] debug ms = 1 2026-02-21T01:27:32.972 INFO:tasks.ceph:[global] debug objecter = 20 2026-02-21T01:27:32.972 INFO:tasks.ceph:[global] debug rados = 20 2026-02-21T01:27:32.972 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-21T01:27:32.973 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-21T01:27:32.973 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-21T01:27:32.973 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-21T01:27:32.973 INFO:tasks.ceph:[global] ms type = async 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] paxos min = 10 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-21T01:27:32.973 INFO:tasks.ceph:[mon] paxos trim min = 10 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bluestore write v2 = False 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-21T01:27:32.973 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-21T01:27:32.974 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-21T01:27:32.974 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-21T01:27:32.974 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-21T01:27:32.974 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-21T01:27:32.974 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-21T01:27:32.974 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-21T01:27:32.974 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-21T01:27:32.974 INFO:tasks.ceph:Setting up mon.a... 2026-02-21T01:27:32.974 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-21T01:27:33.010 INFO:teuthology.orchestra.run.trial043.stdout:creating /etc/ceph/ceph.keyring 2026-02-21T01:27:33.012 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-21T01:27:33.087 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-21T01:27:33.150 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.43:6789]'), ('mon.c', '[v1:10.20.193.43:6790]'), ('mon.b', '[v1:10.20.193.46:6789]')] 2026-02-21T01:27:33.150 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.43:6789],[v1:10.20.193.43:6790],[v1:10.20.193.46:6789]', 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-21T01:27:33.151 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:33.151 DEBUG:teuthology.orchestra.run.trial043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-21T01:27:33.207 DEBUG:teuthology.orchestra.run.trial043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.43:6789]' --addv c '[v1:10.20.193.43:6790]' --addv b '[v1:10.20.193.46:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:33.280 INFO:teuthology.orchestra.run.trial043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:monmaptool: generated fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:setting min_mon_release = tentacle 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:epoch 0 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:min_mon_release 20 (tentacle) 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:election_strategy: 1 2026-02-21T01:27:33.281 INFO:teuthology.orchestra.run.trial043.stdout:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:33.282 INFO:teuthology.orchestra.run.trial043.stdout:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:33.282 INFO:teuthology.orchestra.run.trial043.stdout:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:33.282 INFO:teuthology.orchestra.run.trial043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-21T01:27:33.284 DEBUG:teuthology.orchestra.run.trial043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-21T01:27:33.341 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6ad0f5d2-7471-410a-a664-22f2b680bffe... 2026-02-21T01:27:33.341 DEBUG:teuthology.orchestra.run.trial043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-21T01:27:33.382 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-21T01:27:33.422 INFO:teuthology.orchestra.run.trial043.stdout:[global] 2026-02-21T01:27:33.422 INFO:teuthology.orchestra.run.trial043.stdout: chdir = "" 2026-02-21T01:27:33.422 INFO:teuthology.orchestra.run.trial043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-21T01:27:33.422 INFO:teuthology.orchestra.run.trial043.stdout: auth supported = cephx 2026-02-21T01:27:33.422 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.422 INFO:teuthology.orchestra.run.trial043.stdout: filestore xattr use omap = true 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: mon clock drift allowed = 1.000 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: osd crush chooseleaf type = 0 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: auth debug = true 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: ms die on old message = true 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: ms die on bug = true 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: mon pg warn max object skew = 0 2026-02-21T01:27:33.423 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: # disable pg_autoscaler by default for new pools 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: osd pool default size = 2 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: mon osd allow primary affinity = true 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: mon osd allow pg remap = true 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: mon warn on legacy crush tunables = false 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: mon warn on crush straw calc version zero = false 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: mon warn on no sortbitwise = false 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: mon warn on osd down out interval zero = false 2026-02-21T01:27:33.424 INFO:teuthology.orchestra.run.trial043.stdout: mon warn on too few osds = false 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: mon_allow_pool_size_one = true 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: osd default data pool replay window = 5 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: mon allow pool delete = true 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: mon cluster log file level = debug 2026-02-21T01:27:33.425 INFO:teuthology.orchestra.run.trial043.stdout: debug asserts on shutdown = true 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: mon health detail to clog = false 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: mon host = "[v1:10.20.193.43:6789],[v1:10.20.193.43:6790],[v1:10.20.193.46:6789]" 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: debug ms = 1 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: debug objecter = 20 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: debug rados = 20 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: mon client directed command retry = 5 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: mon election default strategy = 1 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: ms bind msgr2 = False 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: ms inject socket failures = 5000 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: ms type = async 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: fsid = 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:33.426 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout:[osd] 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: osd journal size = 100 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: osd scrub load threshold = 5.0 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: osd scrub max interval = 600 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: osd mclock profile = high_recovery_ops 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: osd mclock skip benchmark = True 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.427 INFO:teuthology.orchestra.run.trial043.stdout: osd recover clone overlap = true 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd recovery max chunk = 1048576 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd debug shutdown = true 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd debug op order = true 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd debug verify stray on activate = true 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd debug trim objects = true 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd open classes on start = true 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd debug pg log writeout = true 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: osd deep scrub update digest min age = 30 2026-02-21T01:27:33.428 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: osd map max advance = 10 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: journal zero on create = true 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: filestore ondisk finisher threads = 3 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: filestore apply finisher threads = 3 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: bdev debug aio = true 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: osd debug misdirected ops = true 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: bdev async discard = True 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: bdev enable discard = True 2026-02-21T01:27:33.429 INFO:teuthology.orchestra.run.trial043.stdout: bluestore allocator = bitmap 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: bluestore block size = 96636764160 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: bluestore fsck on mount = True 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: bluestore onode segment size = 0 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: bluestore write v2 = False 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: bluestore zero block detection = True 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: debug bluefs = 20 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: debug bluestore = 20 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: debug ms = 1 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: debug osd = 20 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: debug rocksdb = 10 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: mon osd backfillfull_ratio = 0.85 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: mon osd full ratio = 0.9 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: mon osd nearfull ratio = 0.8 2026-02-21T01:27:33.430 INFO:teuthology.orchestra.run.trial043.stdout: osd class default list = * 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd class load list = * 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd debug verify cached snaps = True 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd debug verify missing on start = True 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd failsafe full ratio = 0.95 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd mclock override recovery settings = True 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd objectstore = bluestore 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd op queue = debug_random 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: osd op queue cut off = debug_random 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout:[mgr] 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: debug ms = 1 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: debug mgr = 20 2026-02-21T01:27:33.431 INFO:teuthology.orchestra.run.trial043.stdout: debug mon = 20 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: debug auth = 20 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: mon reweight min pgs per osd = 4 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: mon reweight min bytes per osd = 10 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: mgr/telemetry/nag = false 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout:[mon] 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: debug ms = 1 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: debug mon = 20 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: debug paxos = 20 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: debug auth = 20 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: mon data avail warn = 5 2026-02-21T01:27:33.432 INFO:teuthology.orchestra.run.trial043.stdout: mon mgr mkfs grace = 240 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: mon reweight min pgs per osd = 4 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: mon osd reporter subtree level = osd 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: mon osd prime pg temp = true 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: mon reweight min bytes per osd = 10 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: auth mon ticket ttl = 660 # 11m 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: auth service ticket ttl = 240 # 4m 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: # don't complain about insecure global_id in the test suite 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-21T01:27:33.433 INFO:teuthology.orchestra.run.trial043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: # 1m isn't quite enough 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon_down_mkfs_grace = 2m 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon_warn_on_filestore_osds = false 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon min osdmap epochs = 25 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon osdmap full prune interval = 2 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon osdmap full prune min = 15 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon osdmap full prune txsize = 2 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon scrub inject crc mismatch = 0.01 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon scrub inject missing keys = 0.05 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon scrub interval = 300 2026-02-21T01:27:33.434 INFO:teuthology.orchestra.run.trial043.stdout: mon warn on pool no app = False 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: paxos min = 10 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: paxos service trim min = 5 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: paxos trim min = 10 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout:[client] 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: rgw cache enabled = true 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: rgw enable ops log = true 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: rgw enable usage log = true 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: debug monc = 20 2026-02-21T01:27:33.435 INFO:teuthology.orchestra.run.trial043.stdout: debug ms = 1 2026-02-21T01:27:33.436 INFO:teuthology.orchestra.run.trial043.stdout:[mon.a] 2026-02-21T01:27:33.436 INFO:teuthology.orchestra.run.trial043.stdout:[mon.c] 2026-02-21T01:27:33.436 INFO:teuthology.orchestra.run.trial043.stdout:[mon.b] 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout:[global] 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: chdir = "" 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: auth supported = cephx 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: filestore xattr use omap = true 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: mon clock drift allowed = 1.000 2026-02-21T01:27:33.438 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: osd crush chooseleaf type = 0 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: auth debug = true 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: ms die on old message = true 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: ms die on bug = true 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: mon pg warn max object skew = 0 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: # disable pg_autoscaler by default for new pools 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-21T01:27:33.439 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: osd pool default size = 2 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon osd allow primary affinity = true 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon osd allow pg remap = true 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on legacy crush tunables = false 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on crush straw calc version zero = false 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on no sortbitwise = false 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on osd down out interval zero = false 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on too few osds = false 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-21T01:27:33.440 INFO:teuthology.orchestra.run.trial046.stdout: mon_allow_pool_size_one = true 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: osd default data pool replay window = 5 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: mon allow pool delete = true 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: mon cluster log file level = debug 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: debug asserts on shutdown = true 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: mon health detail to clog = false 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: mon host = "[v1:10.20.193.43:6789],[v1:10.20.193.43:6790],[v1:10.20.193.46:6789]" 2026-02-21T01:27:33.441 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 1 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: debug objecter = 20 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: debug rados = 20 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: mon client directed command retry = 5 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: mon election default strategy = 1 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: ms bind msgr2 = False 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: ms inject socket failures = 5000 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: ms type = async 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: fsid = 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout:[osd] 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: osd journal size = 100 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.442 INFO:teuthology.orchestra.run.trial046.stdout: osd scrub load threshold = 5.0 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd scrub max interval = 600 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd mclock profile = high_recovery_ops 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd mclock skip benchmark = True 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd recover clone overlap = true 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd recovery max chunk = 1048576 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd debug shutdown = true 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd debug op order = true 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd debug verify stray on activate = true 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd debug trim objects = true 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.443 INFO:teuthology.orchestra.run.trial046.stdout: osd open classes on start = true 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: osd debug pg log writeout = true 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: osd deep scrub update digest min age = 30 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: osd map max advance = 10 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: journal zero on create = true 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: filestore ondisk finisher threads = 3 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: filestore apply finisher threads = 3 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: bdev debug aio = true 2026-02-21T01:27:33.444 INFO:teuthology.orchestra.run.trial046.stdout: osd debug misdirected ops = true 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bdev async discard = True 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bdev enable discard = True 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bluestore allocator = bitmap 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bluestore block size = 96636764160 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bluestore fsck on mount = True 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bluestore onode segment size = 0 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bluestore write v2 = False 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: bluestore zero block detection = True 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: debug bluefs = 20 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: debug bluestore = 20 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 1 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: debug osd = 20 2026-02-21T01:27:33.445 INFO:teuthology.orchestra.run.trial046.stdout: debug rocksdb = 10 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: mon osd backfillfull_ratio = 0.85 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: mon osd full ratio = 0.9 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: mon osd nearfull ratio = 0.8 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd class default list = * 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd class load list = * 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd debug verify cached snaps = True 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd debug verify missing on start = True 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd failsafe full ratio = 0.95 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd mclock override recovery settings = True 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd objectstore = bluestore 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd op queue = debug_random 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: osd op queue cut off = debug_random 2026-02-21T01:27:33.446 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout:[mgr] 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 1 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: debug mgr = 20 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: debug mon = 20 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: debug auth = 20 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min pgs per osd = 4 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min bytes per osd = 10 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: mgr/telemetry/nag = false 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout:[mon] 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 1 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: debug mon = 20 2026-02-21T01:27:33.447 INFO:teuthology.orchestra.run.trial046.stdout: debug paxos = 20 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: debug auth = 20 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: mon data avail warn = 5 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: mon mgr mkfs grace = 240 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min pgs per osd = 4 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: mon osd reporter subtree level = osd 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: mon osd prime pg temp = true 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min bytes per osd = 10 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: auth mon ticket ttl = 660 # 11m 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: auth service ticket ttl = 240 # 4m 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.448 INFO:teuthology.orchestra.run.trial046.stdout: # don't complain about insecure global_id in the test suite 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: # 1m isn't quite enough 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon_down_mkfs_grace = 2m 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_filestore_osds = false 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon min osdmap epochs = 25 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon osdmap full prune interval = 2 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon osdmap full prune min = 15 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon osdmap full prune txsize = 2 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon scrub inject crc mismatch = 0.01 2026-02-21T01:27:33.449 INFO:teuthology.orchestra.run.trial046.stdout: mon scrub inject missing keys = 0.05 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: mon scrub interval = 300 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on pool no app = False 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: paxos min = 10 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: paxos service trim min = 5 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: paxos trim min = 10 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout:[client] 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: rgw cache enabled = true 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: rgw enable ops log = true 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: rgw enable usage log = true 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-21T01:27:33.450 INFO:teuthology.orchestra.run.trial046.stdout: debug monc = 20 2026-02-21T01:27:33.451 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 1 2026-02-21T01:27:33.451 INFO:teuthology.orchestra.run.trial046.stdout:[mon.a] 2026-02-21T01:27:33.451 INFO:teuthology.orchestra.run.trial046.stdout:[mon.c] 2026-02-21T01:27:33.451 INFO:teuthology.orchestra.run.trial046.stdout:[mon.b] 2026-02-21T01:27:33.451 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-21T01:27:33.451 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-21T01:27:33.522 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-21T01:27:33.522 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:33.523 DEBUG:teuthology.orchestra.run.trial043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-21T01:27:33.579 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:33.580 DEBUG:teuthology.orchestra.run.trial043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-21T01:27:33.638 INFO:tasks.ceph:Sending monmap to node ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:27:33.638 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:33.638 DEBUG:teuthology.orchestra.run.trial043:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-21T01:27:33.638 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-21T01:27:33.710 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:33.710 DEBUG:teuthology.orchestra.run.trial043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:33.766 INFO:tasks.ceph:Sending monmap to node ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:27:33.766 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:33.766 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-21T01:27:33.767 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-21T01:27:33.800 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:33.800 DEBUG:teuthology.orchestra.run.trial046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:33.857 INFO:tasks.ceph:Setting up mon nodes... 2026-02-21T01:27:33.857 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-21T01:27:33.858 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-21T01:27:33.943 INFO:teuthology.orchestra.run.trial046.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-21T01:27:33.945 INFO:tasks.ceph:Setting up mds nodes... 2026-02-21T01:27:33.945 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-21T01:27:33.945 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-21T01:27:33.978 INFO:teuthology.orchestra.run.trial046.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-21T01:27:33.989 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-21T01:27:33.989 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial046.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-21T01:27:33.989 DEBUG:teuthology.orchestra.run.trial043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-21T01:27:34.014 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:34.014 INFO:tasks.ceph:role: osd.0 2026-02-21T01:27:34.014 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:27:34.014 DEBUG:teuthology.orchestra.run.trial043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-21T01:27:34.078 INFO:teuthology.orchestra.run.trial043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-21T01:27:34.078 INFO:teuthology.orchestra.run.trial043.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout: = sunit=0 swidth=0 blks 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-21T01:27:34.079 INFO:teuthology.orchestra.run.trial043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-21T01:27:34.648 INFO:teuthology.orchestra.run.trial043.stdout:Discarding blocks...Done. 2026-02-21T01:27:34.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial043.front.sepia.ceph.com -o noatime 2026-02-21T01:27:34.651 DEBUG:teuthology.orchestra.run.trial043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-21T01:27:34.720 DEBUG:teuthology.orchestra.run.trial043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-21T01:27:34.787 DEBUG:teuthology.orchestra.run.trial043:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-21T01:27:34.851 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:34.851 INFO:tasks.ceph:role: osd.1 2026-02-21T01:27:34.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:27:34.852 DEBUG:teuthology.orchestra.run.trial043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-21T01:27:34.916 INFO:teuthology.orchestra.run.trial043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-21T01:27:34.916 INFO:teuthology.orchestra.run.trial043.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-21T01:27:34.916 INFO:teuthology.orchestra.run.trial043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-21T01:27:34.916 INFO:teuthology.orchestra.run.trial043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-21T01:27:34.916 INFO:teuthology.orchestra.run.trial043.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-21T01:27:34.916 INFO:teuthology.orchestra.run.trial043.stdout: = sunit=0 swidth=0 blks 2026-02-21T01:27:34.917 INFO:teuthology.orchestra.run.trial043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-21T01:27:34.917 INFO:teuthology.orchestra.run.trial043.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-21T01:27:34.917 INFO:teuthology.orchestra.run.trial043.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-21T01:27:34.917 INFO:teuthology.orchestra.run.trial043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-21T01:27:35.476 INFO:teuthology.orchestra.run.trial043.stdout:Discarding blocks...Done. 2026-02-21T01:27:35.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial043.front.sepia.ceph.com -o noatime 2026-02-21T01:27:35.478 DEBUG:teuthology.orchestra.run.trial043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-21T01:27:35.545 DEBUG:teuthology.orchestra.run.trial043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-21T01:27:35.610 DEBUG:teuthology.orchestra.run.trial043:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-21T01:27:35.674 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:35.674 INFO:tasks.ceph:role: osd.2 2026-02-21T01:27:35.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:27:35.674 DEBUG:teuthology.orchestra.run.trial043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout: = sunit=0 swidth=0 blks 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-21T01:27:35.738 INFO:teuthology.orchestra.run.trial043.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-21T01:27:35.739 INFO:teuthology.orchestra.run.trial043.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-21T01:27:35.739 INFO:teuthology.orchestra.run.trial043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-21T01:27:36.298 INFO:teuthology.orchestra.run.trial043.stdout:Discarding blocks...Done. 2026-02-21T01:27:36.299 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial043.front.sepia.ceph.com -o noatime 2026-02-21T01:27:36.300 DEBUG:teuthology.orchestra.run.trial043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-21T01:27:36.368 DEBUG:teuthology.orchestra.run.trial043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-21T01:27:36.436 DEBUG:teuthology.orchestra.run.trial043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:36.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:36.513+0000 7f929900d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-21T01:27:36.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:36.513+0000 7f929900d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-21T01:27:36.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:36.513+0000 7f929900d900 -1 bdev(0x5602dd053800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-21T01:27:36.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:36.513+0000 7f929900d900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-21T01:27:36.965 DEBUG:teuthology.orchestra.run.trial043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-21T01:27:37.029 DEBUG:teuthology.orchestra.run.trial043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:37.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.107+0000 7fb6a85f2900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-21T01:27:37.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.107+0000 7fb6a85f2900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-21T01:27:37.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.107+0000 7fb6a85f2900 -1 bdev(0x5596cc101800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-21T01:27:37.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.107+0000 7fb6a85f2900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-21T01:27:37.609 DEBUG:teuthology.orchestra.run.trial043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-21T01:27:37.672 DEBUG:teuthology.orchestra.run.trial043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:37.751 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.748+0000 7f4a04015900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-21T01:27:37.751 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.749+0000 7f4a04015900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-21T01:27:37.751 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.749+0000 7f4a04015900 -1 bdev(0x556a20d29800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-21T01:27:37.751 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:37.749+0000 7f4a04015900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-21T01:27:38.220 DEBUG:teuthology.orchestra.run.trial043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-21T01:27:38.285 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-21T01:27:38.310 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:38.311 INFO:tasks.ceph:role: osd.3 2026-02-21T01:27:38.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:27:38.311 DEBUG:teuthology.orchestra.run.trial046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout: = sunit=0 swidth=0 blks 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-21T01:27:38.375 INFO:teuthology.orchestra.run.trial046.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-21T01:27:38.376 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-21T01:27:38.376 INFO:teuthology.orchestra.run.trial046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-21T01:27:38.960 INFO:teuthology.orchestra.run.trial046.stdout:Discarding blocks...Done. 2026-02-21T01:27:38.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial046.front.sepia.ceph.com -o noatime 2026-02-21T01:27:38.962 DEBUG:teuthology.orchestra.run.trial046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-21T01:27:39.030 DEBUG:teuthology.orchestra.run.trial046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-21T01:27:39.097 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-21T01:27:39.160 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:39.160 INFO:tasks.ceph:role: osd.4 2026-02-21T01:27:39.160 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:27:39.160 DEBUG:teuthology.orchestra.run.trial046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-21T01:27:39.226 INFO:teuthology.orchestra.run.trial046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout: = sunit=0 swidth=0 blks 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-21T01:27:39.227 INFO:teuthology.orchestra.run.trial046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-21T01:27:39.789 INFO:teuthology.orchestra.run.trial046.stdout:Discarding blocks...Done. 2026-02-21T01:27:39.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial046.front.sepia.ceph.com -o noatime 2026-02-21T01:27:39.792 DEBUG:teuthology.orchestra.run.trial046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-21T01:27:39.860 DEBUG:teuthology.orchestra.run.trial046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-21T01:27:39.926 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-21T01:27:39.989 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-21T01:27:39.990 INFO:tasks.ceph:role: osd.5 2026-02-21T01:27:39.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:27:39.990 DEBUG:teuthology.orchestra.run.trial046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout: = sunit=0 swidth=0 blks 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-21T01:27:40.054 INFO:teuthology.orchestra.run.trial046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-21T01:27:40.627 INFO:teuthology.orchestra.run.trial046.stdout:Discarding blocks...Done. 2026-02-21T01:27:40.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial046.front.sepia.ceph.com -o noatime 2026-02-21T01:27:40.630 DEBUG:teuthology.orchestra.run.trial046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-21T01:27:40.698 DEBUG:teuthology.orchestra.run.trial046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-21T01:27:40.765 DEBUG:teuthology.orchestra.run.trial046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:40.844 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:40.841+0000 7f91e4b27900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-21T01:27:40.844 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:40.841+0000 7f91e4b27900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-21T01:27:40.844 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:40.841+0000 7f91e4b27900 -1 bdev(0x555c41071800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-21T01:27:40.844 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:40.841+0000 7f91e4b27900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-21T01:27:41.291 DEBUG:teuthology.orchestra.run.trial046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-21T01:27:41.356 DEBUG:teuthology.orchestra.run.trial046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:41.433 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:41.429+0000 7f8639103900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-21T01:27:41.433 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:41.430+0000 7f8639103900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-21T01:27:41.433 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:41.430+0000 7f8639103900 -1 bdev(0x55ad40a03800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-21T01:27:41.433 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:41.430+0000 7f8639103900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-21T01:27:41.909 DEBUG:teuthology.orchestra.run.trial046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-21T01:27:41.974 DEBUG:teuthology.orchestra.run.trial046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:42.052 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:42.049+0000 7f11c2388900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-21T01:27:42.052 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:42.049+0000 7f11c2388900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-21T01:27:42.052 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:42.049+0000 7f11c2388900 -1 bdev(0x560d9637b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-21T01:27:42.052 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:42.049+0000 7f11c2388900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-21T01:27:42.514 DEBUG:teuthology.orchestra.run.trial046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-21T01:27:42.579 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-21T01:27:42.580 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:42.580 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-21T01:27:42.606 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:42.606 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-21T01:27:42.670 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:42.670 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-21T01:27:42.734 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:42.734 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-21T01:27:42.760 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:42.760 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-21T01:27:42.826 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:42.826 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-21T01:27:42.889 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:42.890 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-21T01:27:42.954 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:42.954 DEBUG:teuthology.orchestra.run.trial046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-21T01:27:43.009 INFO:tasks.ceph:Adding keys to all mons... 2026-02-21T01:27:43.009 DEBUG:teuthology.orchestra.run.trial043:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-21T01:27:43.011 DEBUG:teuthology.orchestra.run.trial046:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-21T01:27:43.052 INFO:teuthology.orchestra.run.trial043.stdout:[osd.0] 2026-02-21T01:27:43.052 INFO:teuthology.orchestra.run.trial043.stdout: key = AQAICplpiaOsHhAALo22YlbzakMhadZYaNlpXA== 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout:[osd.1] 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout: key = AQAJCplpB1p9BhAA4RBlXoBM6Dfj9vd6fOi5Og== 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout:[osd.2] 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout: key = AQAJCplpJG+4LBAAbhJWBhhGQ43j2bFxZERg4Q== 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout:[mgr.x] 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout: key = AQAFCplpeeMxOBAAoE/ofMtIHhP0MEBrYsu4hw== 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout:[osd.3] 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout: key = AQAMCplpJxQ7MhAANJDupT7RTs5Orb9Ab7QwIg== 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout:[osd.4] 2026-02-21T01:27:43.053 INFO:teuthology.orchestra.run.trial043.stdout: key = AQANCplp7Hi3GRAA0GR4QSsFY2tH5PvZ9fBbYg== 2026-02-21T01:27:43.054 INFO:teuthology.orchestra.run.trial043.stdout:[osd.5] 2026-02-21T01:27:43.054 INFO:teuthology.orchestra.run.trial043.stdout: key = AQAOCplpL60DAxAAKjrumIoiqvTeu/IMYiWS6w== 2026-02-21T01:27:43.054 INFO:teuthology.orchestra.run.trial043.stdout:[client.0] 2026-02-21T01:27:43.054 INFO:teuthology.orchestra.run.trial043.stdout: key = AQAFCplpQZNPOhAAvrEMo+i5Agll3iJvzoPibQ== 2026-02-21T01:27:43.071 INFO:teuthology.orchestra.run.trial046.stdout:[osd.0] 2026-02-21T01:27:43.071 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAICplpiaOsHhAALo22YlbzakMhadZYaNlpXA== 2026-02-21T01:27:43.071 INFO:teuthology.orchestra.run.trial046.stdout:[osd.1] 2026-02-21T01:27:43.071 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAJCplpB1p9BhAA4RBlXoBM6Dfj9vd6fOi5Og== 2026-02-21T01:27:43.071 INFO:teuthology.orchestra.run.trial046.stdout:[osd.2] 2026-02-21T01:27:43.071 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAJCplpJG+4LBAAbhJWBhhGQ43j2bFxZERg4Q== 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout:[mgr.x] 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAFCplpeeMxOBAAoE/ofMtIHhP0MEBrYsu4hw== 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout:[osd.3] 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAMCplpJxQ7MhAANJDupT7RTs5Orb9Ab7QwIg== 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout:[osd.4] 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout: key = AQANCplp7Hi3GRAA0GR4QSsFY2tH5PvZ9fBbYg== 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout:[osd.5] 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAOCplpL60DAxAAKjrumIoiqvTeu/IMYiWS6w== 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout:[client.0] 2026-02-21T01:27:43.072 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAFCplpQZNPOhAAvrEMo+i5Agll3iJvzoPibQ== 2026-02-21T01:27:43.072 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.097 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.153 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.178 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.232 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.257 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.312 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-21T01:27:43.337 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-21T01:27:43.392 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.418 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.472 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.497 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.549 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.576 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-21T01:27:43.628 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-21T01:27:43.655 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-21T01:27:43.709 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-21T01:27:43.709 DEBUG:teuthology.orchestra.run.trial043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-21T01:27:43.759 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-21T01:27:43.841 DEBUG:teuthology.orchestra.run.trial043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-21T01:27:43.906 DEBUG:teuthology.orchestra.run.trial043:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-21T01:27:43.970 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-21T01:27:44.055 DEBUG:teuthology.orchestra.run.trial043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-21T01:27:44.080 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-21T01:27:44.105 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-21T01:27:44.188 DEBUG:teuthology.orchestra.run.trial046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-21T01:27:44.253 DEBUG:teuthology.orchestra.run.trial043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:44.256 DEBUG:teuthology.orchestra.run.trial046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-21T01:27:44.309 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-21T01:27:44.310 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-21T01:27:44.310 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-21T01:27:44.313 INFO:tasks.ceph.mon.a:Started 2026-02-21T01:27:44.313 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-21T01:27:44.314 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-21T01:27:44.316 INFO:tasks.ceph.mon.c:Started 2026-02-21T01:27:44.316 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-21T01:27:44.316 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-21T01:27:44.351 INFO:tasks.ceph.mon.b:Started 2026-02-21T01:27:44.351 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-21T01:27:44.351 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-21T01:27:44.351 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-21T01:27:44.352 INFO:tasks.ceph.mgr.x:Started 2026-02-21T01:27:44.353 DEBUG:tasks.ceph:set 0 configs 2026-02-21T01:27:44.353 DEBUG:teuthology.orchestra.run.trial043:> sudo ceph --cluster ceph config dump 2026-02-21T01:27:44.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.413+0000 7f7cdf7d9640 10 monclient: get_monmap_and_config 2026-02-21T01:27:44.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.413+0000 7f7cdf7d9640 10 monclient: build_initial_monmap 2026-02-21T01:27:44.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.413+0000 7f7cdf7d9640 10 monclient: monmap: 2026-02-21T01:27:44.416 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:44.416 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.416 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:44.414007+0000 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:44.414007+0000 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 1 Processor -- start 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 1 -- start start 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient: init 2026-02-21T01:27:44.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient(hunting): picked mon.noname-a con 0x7f7cd8058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient(hunting): picked mon.noname-b con 0x7f7cd8057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient(hunting): picked mon.noname-c con 0x7f7cd8181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd8056c50 con 0x7f7cd8058260 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd808eda0 con 0x7f7cd8181e80 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd808f5c0 con 0x7f7cd8057630 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdf7d9640 10 monclient(hunting): authenticate will time out at 596.119465s 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdcd4d640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f7cd8057630 0x7f7cd808e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:46600/0 (socket says 10.20.193.43:46600) 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdd54e640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f7cd8058260 0x7f7cd808df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:35768/0 (socket says 10.20.193.43:35768) 2026-02-21T01:27:44.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.414+0000 7f7cdcd4d640 1 -- 10.20.193.43:0/2546421412 learned_addr learned my addr 10.20.193.43:0/2546421412 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354732241 0 0) 0x7f7cd8056c50 con 0x7f7cd8058260 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): my global_id is 4098 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc0003610 con 0x7f7cd8058260 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811612575 0 0) 0x7f7cd808eda0 con 0x7f7cd8181e80 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient(hunting): my global_id is 4099 2026-02-21T01:27:44.589 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cd8056c50 con 0x7f7cd8181e80 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2564749342 0 0) 0x7f7cc0003610 con 0x7f7cd8058260 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 >> v1:10.20.193.43:6790/0 conn(0x7f7cd8057630 legacy=0x7f7cd808e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 >> v1:10.20.193.46:6789/0 conn(0x7f7cd8181e80 legacy=0x7f7cd81a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 monclient: found mon.noname-a 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd80563b0 con 0x7f7cd8058260 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: _finish_auth 0 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cc8002df0 con 0x7f7cd8058260 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: dump: 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cdf7d9640 5 monclient: authenticate success, global_id 4098 2026-02-21T01:27:44.590 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cdf7d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cc8003040 con 0x7f7cd8058260 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 1 -- 10.20.193.43:0/2546421412 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cc8003480 con 0x7f7cd8058260 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cc7fff640 10 monclient: dump: 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cdf7d9640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.587+0000 7f7cdf7d9640 4 set_mon_vals no callback set 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 10 monclient: shutdown 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/2546421412 >> v1:10.20.193.43:6789/0 conn(0x7f7cd8058260 legacy=0x7f7cd808df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/2546421412 shutdown_connections 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/2546421412 >> 10.20.193.43:0/2546421412 conn(0x7f7cd8090360 msgr2=0x7f7cd8090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/2546421412 shutdown_connections 2026-02-21T01:27:44.591 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/2546421412 wait complete. 2026-02-21T01:27:44.593 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 10 monclient: build_initial_monmap 2026-02-21T01:27:44.593 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 10 monclient: monmap: 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 librados: starting msgr at 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 librados: starting objecter 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 Processor -- start 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 -- start start 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 librados: setting wanted keys 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 1 librados: calling monclient init 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.588+0000 7f7cdf7d9640 10 monclient: init 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient(hunting): picked mon.noname-a con 0x7f7cd8057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient(hunting): picked mon.noname-b con 0x7f7cd8058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient(hunting): picked mon.noname-c con 0x7f7cd8181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd812fbd0 con 0x7f7cd8057630 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd81497f0 con 0x7f7cd8058260 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd808a870 con 0x7f7cd8181e80 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient(hunting): authenticate will time out at 596.294210s 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdd54e640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f7cd8057630 0x7f7cd81490e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:35788/0 (socket says 10.20.193.43:35788) 2026-02-21T01:27:44.594 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdd54e640 1 -- 10.20.193.43:0/1354552801 learned_addr learned my addr 10.20.193.43:0/1354552801 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 client.?.objecter ms_handle_connect 0x7f7cd8057630 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 client.?.objecter ms_handle_connect 0x7f7cd8181e80 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851741673 0 0) 0x7f7cd812fbd0 con 0x7f7cd8057630 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): my global_id is 4104 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ca8003610 con 0x7f7cd8057630 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1583405342 0 0) 0x7f7ca8003610 con 0x7f7cd8057630 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cd812fbd0 con 0x7f7cd8057630 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cc8003390 con 0x7f7cd8057630 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): dump: 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 client.?.objecter ms_handle_connect 0x7f7cd8058260 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2919432233 0 0) 0x7f7cd812fbd0 con 0x7f7cd8057630 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 >> v1:10.20.193.43:6790/0 conn(0x7f7cd8181e80 legacy=0x7f7cd8171bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 >> v1:10.20.193.46:6789/0 conn(0x7f7cd8058260 legacy=0x7f7cd8170490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 monclient: found mon.a 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd812e6e0 con 0x7f7cd8057630 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cc5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 5 monclient: authenticate success, global_id 4104 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient: _renew_subs 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd8130a40 con 0x7f7cd8057630 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 client.4104.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient: _renew_subs 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cd814c2b0 con 0x7f7cd8057630 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.589+0000 7f7cdf7d9640 1 librados: init done 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cc8003040 con 0x7f7cd8057630 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cc8004e00 con 0x7f7cd8057630 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc77fe640 4 set_mon_vals no callback set 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 10 monclient: dump: 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.596 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7cc8005430 con 0x7f7cd8057630 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1325639861 0 0) 0x7f7cc8006d40 con 0x7f7cd8057630 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 10 client.4104.objecter ms_dispatch2 0x7f7cd8000b90 osd_map(1..1 src has 1..1) 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 3 client.4104.objecter handle_osd_map got epochs [1,1] > 0 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 3 client.4104.objecter handle_osd_map decoding full epoch 1 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cc5ffb640 20 client.4104.objecter dump_active .. 0 homeless 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cdf7d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cdf7d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cdf7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.590+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd81302b0 con 0x7f7cd8057630 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.592+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f7cc80058e0 con 0x7f7cd8057630 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.592+0000 7f7cc5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:44.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.592+0000 7f7cc5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:44.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-21T01:27:44.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-21T01:27:44.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f7cd8054d90 con 0x7f7cd8057630 2026-02-21T01:27:44.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cc5ffb640 1 -- 10.20.193.43:0/1354552801 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f7cc8005b40 con 0x7f7cd8057630 2026-02-21T01:27:44.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cc5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-21T01:27:44.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cc5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:44.623 INFO:teuthology.orchestra.run.trial043.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 10 librados: watch_flush enter 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 10 librados: watch_flush exit 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 20 client.4104.objecter shutdown clearing up homeless session... 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 10 client.4104.objecter successfully canceled tick 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 10 monclient: shutdown 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 >> v1:10.20.193.43:6789/0 conn(0x7f7cd8057630 legacy=0x7f7cd81490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 shutdown_connections 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 >> 10.20.193.43:0/1354552801 conn(0x7f7cd8090360 msgr2=0x7f7cd808b370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 shutdown_connections 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.621+0000 7f7cdf7d9640 1 -- 10.20.193.43:0/1354552801 wait complete. 2026-02-21T01:27:44.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.622+0000 7f7cdf7d9640 1 librados: shutdown 2026-02-21T01:27:44.630 INFO:tasks.ceph:Setting crush tunables to default 2026-02-21T01:27:44.631 DEBUG:teuthology.orchestra.run.trial043:> sudo ceph --cluster ceph osd crush tunables default 2026-02-21T01:27:44.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient: get_monmap_and_config 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient: build_initial_monmap 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient: monmap: 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:44.696415+0000 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:44.696415+0000 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:44.707 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 1 Processor -- start 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 1 -- start start 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient: init 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient(hunting): picked mon.noname-b con 0x7fccdc08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient(hunting): picked mon.noname-a con 0x7fccdc08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:44.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient(hunting): picked mon.noname-c con 0x7fccdc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc08a690 con 0x7fccdc08d4d0 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc08b910 con 0x7fccdc08d8d0 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc088ae0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce2acd640 10 monclient(hunting): authenticate will time out at 596.401909s 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fccd3fff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fccdc08d4d0 0x7fccdc17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:35794/0 (socket says 10.20.193.43:35794) 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fccd3fff640 1 -- 10.20.193.43:0/1431063543 learned_addr learned my addr 10.20.193.43:0/1431063543 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.696+0000 7fcce0842640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fccdc08ddb0 0x7fccdc08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:46632/0 (socket says 10.20.193.43:46632) 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826555670 0 0) 0x7fccdc08a690 con 0x7fccdc08d4d0 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): my global_id is 4110 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc8003610 con 0x7fccdc08d4d0 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924108855 0 0) 0x7fccdc088ae0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient(hunting): my global_id is 4106 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccdc08a690 con 0x7fccdc08ddb0 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4071027228 0 0) 0x7fccdc08a690 con 0x7fccdc08ddb0 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 >> v1:10.20.193.46:6789/0 conn(0x7fccdc08d8d0 legacy=0x7fccdc19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:44.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 >> v1:10.20.193.43:6789/0 conn(0x7fccdc08d4d0 legacy=0x7fccdc17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 monclient: found mon.noname-b 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc1a3ef0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fcccc002df0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 5 monclient: authenticate success, global_id 4106 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:44.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: dump: 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:44.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcccc003030 con 0x7fccdc08ddb0 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 1 -- 10.20.193.43:0/1431063543 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fcccc003470 con 0x7fccdc08ddb0 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 4 set_mon_vals no callback set 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fccd37fe640 10 monclient: dump: 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.713 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 10 monclient: shutdown 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 1 -- 10.20.193.43:0/1431063543 >> v1:10.20.193.43:6790/0 conn(0x7fccdc08ddb0 legacy=0x7fccdc08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 1 -- 10.20.193.43:0/1431063543 shutdown_connections 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 1 -- 10.20.193.43:0/1431063543 >> 10.20.193.43:0/1431063543 conn(0x7fccdc08f480 msgr2=0x7fccdc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:44.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 1 -- 10.20.193.43:0/1431063543 shutdown_connections 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.697+0000 7fcce2acd640 1 -- 10.20.193.43:0/1431063543 wait complete. 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient: build_initial_monmap 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient: monmap: 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:44.715 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 librados: starting msgr at 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 librados: starting objecter 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 Processor -- start 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 -- start start 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 librados: setting wanted keys 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 librados: calling monclient init 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient: init 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:44.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient(hunting): picked mon.noname-b con 0x7fccdc08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient(hunting): picked mon.noname-c con 0x7fccdc08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient(hunting): picked mon.noname-a con 0x7fccdc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc13a640 con 0x7fccdc08ddb0 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc05e1b0 con 0x7fccdc08d4d0 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc12aac0 con 0x7fccdc08d8d0 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fcce2acd640 10 monclient(hunting): authenticate will time out at 596.403656s 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd3fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fccdc08d8d0 0x7fccdc18b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:46648/0 (socket says 10.20.193.43:46648) 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd3fff640 1 -- 10.20.193.43:0/1577274064 learned_addr learned my addr 10.20.193.43:0/1577274064 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 client.?.objecter ms_handle_connect 0x7fccdc08d8d0 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:44.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 client.?.objecter ms_handle_connect 0x7fccdc08ddb0 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892971906 0 0) 0x7fccdc12aac0 con 0x7fccdc08d8d0 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): my global_id is 4109 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccac003610 con 0x7fccdc08d8d0 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 client.?.objecter ms_handle_connect 0x7fccdc08d4d0 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567107811 0 0) 0x7fccdc13a640 con 0x7fccdc08ddb0 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): my global_id is 4113 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccdc12aac0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896568790 0 0) 0x7fccdc05e1b0 con 0x7fccdc08d4d0 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): my global_id is 4105 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccdc13a640 con 0x7fccdc08d4d0 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2068059816 0 0) 0x7fccdc12aac0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccdc05e1b0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fccd8003040 con 0x7fccdc08ddb0 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.698+0000 7fccd17fa640 10 monclient(hunting): dump: 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.720 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2003576903 0 0) 0x7fccac003610 con 0x7fccdc08d8d0 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccdc12aac0 con 0x7fccdc08d8d0 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fccc4003170 con 0x7fccdc08d8d0 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient(hunting): dump: 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.721 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4092687997 0 0) 0x7fccdc05e1b0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 >> v1:10.20.193.43:6790/0 conn(0x7fccdc08d8d0 legacy=0x7fccdc18b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 >> v1:10.20.193.46:6789/0 conn(0x7fccdc08d4d0 legacy=0x7fccdc139f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: _finish_hunting 0 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 monclient: found mon.a 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:44.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc1295d0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: _finish_auth 0 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: _check_auth_tickets 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 5 monclient: authenticate success, global_id 4113 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 monclient: _renew_subs 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc12b930 con 0x7fccdc08ddb0 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 client.4113.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 monclient: _renew_subs 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fccdc12a310 con 0x7fccdc08ddb0 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 1 librados: init done 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fccd8003700 con 0x7fccdc08ddb0 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fccd8003cb0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 monclient: dump: 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:44.724 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd2ffd640 4 set_mon_vals no callback set 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fccd8004260 con 0x7fccdc08ddb0 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1325639861 0 0) 0x7fccd8005a80 con 0x7fccdc08ddb0 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 10 client.4113.objecter ms_dispatch2 0x7fccdc000b90 osd_map(1..1 src has 1..1) 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 3 client.4113.objecter handle_osd_map got epochs [1,1] > 0 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 3 client.4113.objecter handle_osd_map decoding full epoch 1 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fccd17fa640 20 client.4113.objecter dump_active .. 0 homeless 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:44.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:44.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.699+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc08edd0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.700+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fccd8004f40 con 0x7fccdc08ddb0 2026-02-21T01:27:44.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.700+0000 7fccd17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:44.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.700+0000 7fccd17fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:44.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.730+0000 7fcce2acd640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-21T01:27:44.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.730+0000 7fcce2acd640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-21T01:27:44.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.730+0000 7fcce2acd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:44.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.730+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fccdc054ff0 con 0x7fccdc08ddb0 2026-02-21T01:27:44.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fccd17fa640 1 -- 10.20.193.43:0/1577274064 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fccd8004660 con 0x7fccdc08ddb0 2026-02-21T01:27:44.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fccd17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-21T01:27:44.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fccd17fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-21T01:27:44.733 INFO:teuthology.orchestra.run.trial043.stderr:adjusted tunables profile to default 2026-02-21T01:27:44.733 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 10 librados: watch_flush enter 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 10 librados: watch_flush exit 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 20 client.4113.objecter shutdown clearing up homeless session... 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 10 client.4113.objecter successfully canceled tick 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 10 monclient: shutdown 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 >> v1:10.20.193.43:6789/0 conn(0x7fccdc08ddb0 legacy=0x7fccdc18cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 shutdown_connections 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.732+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 >> 10.20.193.43:0/1577274064 conn(0x7fccdc08f480 msgr2=0x7fccdc1a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.733+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 shutdown_connections 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.733+0000 7fcce2acd640 1 -- 10.20.193.43:0/1577274064 wait complete. 2026-02-21T01:27:44.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:44.733+0000 7fcce2acd640 1 librados: shutdown 2026-02-21T01:27:44.741 INFO:tasks.ceph:check_enable_crimson: False 2026-02-21T01:27:44.741 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-21T01:27:44.741 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:44.741 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-21T01:27:44.765 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:44.765 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-21T01:27:44.829 DEBUG:teuthology.orchestra.run.trial043:> set -ex 2026-02-21T01:27:44.830 DEBUG:teuthology.orchestra.run.trial043:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-21T01:27:44.893 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:44.893 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-21T01:27:44.917 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:44.917 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-21T01:27:44.982 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:27:44.983 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-21T01:27:45.045 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd new e67289af-bac2-443d-83b5-4766298e9303 0 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.145+0000 7f77652e8640 10 monclient: get_monmap_and_config 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.145+0000 7f77652e8640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.145+0000 7f77652e8640 10 monclient: monmap: 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:45.147293+0000 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:45.147293+0000 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.148 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:45.149 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:45.149 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.149 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 1 Processor -- start 2026-02-21T01:27:45.149 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 1 -- start start 2026-02-21T01:27:45.149 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient: init 2026-02-21T01:27:45.154 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.154 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:45.154 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient(hunting): picked mon.noname-c con 0x7f776008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient(hunting): picked mon.noname-a con 0x7f776008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient(hunting): picked mon.noname-b con 0x7f776008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f776008a690 con 0x7f776008d4d0 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f776008b910 con 0x7f776008ddb0 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7760088ae0 con 0x7f776008d8d0 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f77652e8640 10 monclient(hunting): authenticate will time out at 603.835620s 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775effd640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f776008ddb0 0x7f776008e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52030/0 (socket says 10.20.193.46:52030) 2026-02-21T01:27:45.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775effd640 1 -- 10.20.193.46:0/3009200639 learned_addr learned my addr 10.20.193.46:0/3009200639 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933428957 0 0) 0x7f776008b910 con 0x7f776008ddb0 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775dffb640 10 monclient(hunting): my global_id is 4108 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.146+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f774c003610 con 0x7f776008ddb0 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775f7fe640 1 -- 10.20.193.46:0/3009200639 >> v1:10.20.193.43:6790/0 conn(0x7f776008d8d0 legacy=0x7f776019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775f7fe640 1 -- 10.20.193.46:0/3009200639 >> v1:10.20.193.43:6790/0 conn(0x7f776008d8d0 legacy=0x7f776019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775f7fe640 1 --1- 10.20.193.46:0/3009200639 >> v1:10.20.193.43:6790/0 conn(0x7f776008d8d0 0x7f776019f7a0 :-1 s=OPENED pgs=17 cs=1 l=1).handle_message read tag failed 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775f7fe640 1 --1- 10.20.193.46:0/3009200639 >> v1:10.20.193.43:6790/0 conn(0x7f776008d8d0 0x7f776019f7a0 :-1 s=OPENED pgs=17 cs=1 l=1).fault on lossy channel, failing 2026-02-21T01:27:45.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.43:6790/0 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3439460059 0 0) 0x7f774c003610 con 0x7f776008ddb0 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 >> v1:10.20.193.43:6790/0 conn(0x7f776008d8d0 legacy=0x7f776019f7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 >> v1:10.20.193.43:6789/0 conn(0x7f776008d4d0 legacy=0x7f776017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 monclient: found mon.noname-c 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77601a3ef0 con 0x7f776008ddb0 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.157 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 5 monclient: authenticate success, global_id 4108 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7754002df0 con 0x7f776008ddb0 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: dump: 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.158 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77540030f0 con 0x7f776008ddb0 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 1 -- 10.20.193.46:0/3009200639 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7754003530 con 0x7f776008ddb0 2026-02-21T01:27:45.159 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 4 set_mon_vals no callback set 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f775dffb640 10 monclient: dump: 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.160 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 10 monclient: shutdown 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 -- 10.20.193.46:0/3009200639 >> v1:10.20.193.46:6789/0 conn(0x7f776008ddb0 legacy=0x7f776008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 -- 10.20.193.46:0/3009200639 shutdown_connections 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 -- 10.20.193.46:0/3009200639 >> 10.20.193.46:0/3009200639 conn(0x7f776008f480 msgr2=0x7f776008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 -- 10.20.193.46:0/3009200639 shutdown_connections 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 -- 10.20.193.46:0/3009200639 wait complete. 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 10 monclient: monmap: 2026-02-21T01:27:45.161 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 0.000000 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:created 0.000000 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 librados: starting msgr at 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 librados: starting objecter 2026-02-21T01:27:45.162 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.147+0000 7f77652e8640 1 Processor -- start 2026-02-21T01:27:45.163 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 -- start start 2026-02-21T01:27:45.163 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 librados: setting wanted keys 2026-02-21T01:27:45.163 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 librados: calling monclient init 2026-02-21T01:27:45.163 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient: init 2026-02-21T01:27:45.163 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.163 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:45.163 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient(hunting): picked mon.noname-b con 0x7f776008d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.164 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient(hunting): picked mon.noname-c con 0x7f776008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.164 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient(hunting): picked mon.noname-a con 0x7f776008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.164 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77600571a0 con 0x7f776008ddb0 2026-02-21T01:27:45.164 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f776005e1b0 con 0x7f776008d4d0 2026-02-21T01:27:45.164 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7760122ab0 con 0x7f776008d8d0 2026-02-21T01:27:45.164 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.165 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient(hunting): authenticate will time out at 603.837273s 2026-02-21T01:27:45.165 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f775effd640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f776008d4d0 0x7f77601399b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52034/0 (socket says 10.20.193.46:52034) 2026-02-21T01:27:45.165 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f775effd640 1 -- 10.20.193.46:0/1137293732 learned_addr learned my addr 10.20.193.46:0/1137293732 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.165 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 client.?.objecter ms_handle_connect 0x7f776008d4d0 2026-02-21T01:27:45.165 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.165 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016214931 0 0) 0x7f776005e1b0 con 0x7f776008d4d0 2026-02-21T01:27:45.165 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.166 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.166 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.166 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): my global_id is 4111 2026-02-21T01:27:45.166 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f772c003610 con 0x7f776008d4d0 2026-02-21T01:27:45.166 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4219769670 0 0) 0x7f772c003610 con 0x7f776008d4d0 2026-02-21T01:27:45.166 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f776005e1b0 con 0x7f776008d4d0 2026-02-21T01:27:45.166 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7754002db0 con 0x7f776008d4d0 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): dump: 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.167 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1100470706 0 0) 0x7f776005e1b0 con 0x7f776008d4d0 2026-02-21T01:27:45.168 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 >> v1:10.20.193.43:6790/0 conn(0x7f776008d8d0 legacy=0x7f776013a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 >> v1:10.20.193.43:6789/0 conn(0x7f776008ddb0 legacy=0x7f776019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 monclient: found mon.b 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7760107620 con 0x7f776008d4d0 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 5 monclient: authenticate success, global_id 4111 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient: _renew_subs 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7760107340 con 0x7f776008d4d0 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 client.4111.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient: _renew_subs 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f776012c5b0 con 0x7f776008d4d0 2026-02-21T01:27:45.170 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7754004d50 con 0x7f776008d4d0 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f77652e8640 1 librados: init done 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f77540050a0 con 0x7f776008d4d0 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f775d7fa640 4 set_mon_vals no callback set 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 monclient: dump: 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.171 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.172 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.173 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7754005650 con 0x7f776008d4d0 2026-02-21T01:27:45.173 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 3132066707 0 0) 0x7f7754006b40 con 0x7f776008d4d0 2026-02-21T01:27:45.173 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 10 client.4111.objecter ms_dispatch2 0x7f7760000b90 osd_map(2..2 src has 1..2) 2026-02-21T01:27:45.173 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 3 client.4111.objecter handle_osd_map got epochs [2,2] > 0 2026-02-21T01:27:45.173 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 3 client.4111.objecter handle_osd_map decoding full epoch 2 2026-02-21T01:27:45.173 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.148+0000 7f773f7fe640 20 client.4111.objecter dump_active .. 0 homeless 2026-02-21T01:27:45.173 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.149+0000 7f77652e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.174 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.149+0000 7f77652e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.174 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.149+0000 7f77652e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.174 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.149+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f776008edd0 con 0x7f776008d4d0 2026-02-21T01:27:45.174 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.150+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f7754005970 con 0x7f776008d4d0 2026-02-21T01:27:45.174 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.150+0000 7f773f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.174 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.150+0000 7f773f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:45.186 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.183+0000 7f77652e8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e67289af-bac2-443d-83b5-4766298e9303", "id": 0}] 2026-02-21T01:27:45.186 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.183+0000 7f77652e8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e67289af-bac2-443d-83b5-4766298e9303", "id": 0}] 2026-02-21T01:27:45.186 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.183+0000 7f77652e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.186 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.183+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e67289af-bac2-443d-83b5-4766298e9303", "id": 0} v 0) -- 0x7f7760054ff0 con 0x7f776008d4d0 2026-02-21T01:27:45.188 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f773f7fe640 1 -- 10.20.193.46:0/1137293732 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e67289af-bac2-443d-83b5-4766298e9303", "id": 0}]=0 v3) ==== 112+0+2 (unknown 975337491 0 732707515) 0x7f7754005bf0 con 0x7f776008d4d0 2026-02-21T01:27:45.188 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f773f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e67289af-bac2-443d-83b5-4766298e9303", "id": 0}] 2026-02-21T01:27:45.188 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f773f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:45.189 INFO:teuthology.orchestra.run.trial046.stdout:0 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 10 librados: watch_flush enter 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 10 librados: watch_flush exit 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 20 client.4111.objecter shutdown clearing up homeless session... 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 10 client.4111.objecter successfully canceled tick 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 10 monclient: shutdown 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 >> v1:10.20.193.46:6789/0 conn(0x7f776008d4d0 legacy=0x7f77601399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 shutdown_connections 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 >> 10.20.193.46:0/1137293732 conn(0x7f776008f480 msgr2=0x7f77601a2170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.190 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 shutdown_connections 2026-02-21T01:27:45.191 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 1 -- 10.20.193.46:0/1137293732 wait complete. 2026-02-21T01:27:45.191 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.186+0000 7f77652e8640 1 librados: shutdown 2026-02-21T01:27:45.197 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd new 4207f5e8-3ce8-4f55-bb23-a8605d56d872 1 2026-02-21T01:27:45.271 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient: get_monmap_and_config 2026-02-21T01:27:45.271 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.271 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient: monmap: 2026-02-21T01:27:45.271 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:45.259738+0000 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:45.259738+0000 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 1 Processor -- start 2026-02-21T01:27:45.272 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 1 -- start start 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient: init 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient(hunting): picked mon.noname-c con 0x7f595408ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient(hunting): picked mon.noname-b con 0x7f595408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient(hunting): picked mon.noname-a con 0x7f595408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595408a690 con 0x7f595408d8d0 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595408b910 con 0x7f595408ddb0 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5954088ae0 con 0x7f595408d4d0 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.273 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.258+0000 7f595b15c640 10 monclient(hunting): authenticate will time out at 603.947987s 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f5958ed1640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f595408ddb0 0x7f595408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52036/0 (socket says 10.20.193.46:52036) 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f5958ed1640 1 -- 10.20.193.46:0/982028568 learned_addr learned my addr 10.20.193.46:0/982028568 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161816926 0 0) 0x7f595408b910 con 0x7f595408ddb0 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient(hunting): my global_id is 4114 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5940003610 con 0x7f595408ddb0 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3556211419 0 0) 0x7f5940003610 con 0x7f595408ddb0 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 >> v1:10.20.193.43:6790/0 conn(0x7f595408d4d0 legacy=0x7f595417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 >> v1:10.20.193.43:6789/0 conn(0x7f595408d8d0 legacy=0x7f595419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:45.274 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 monclient: found mon.noname-c 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59541a3ef0 con 0x7f595408ddb0 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 5 monclient: authenticate success, global_id 4114 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5944002df0 con 0x7f595408ddb0 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: dump: 2026-02-21T01:27:45.275 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59440030f0 con 0x7f595408ddb0 2026-02-21T01:27:45.276 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 1 -- 10.20.193.46:0/982028568 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5944003530 con 0x7f595408ddb0 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 4 set_mon_vals no callback set 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f594b7fe640 10 monclient: dump: 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.277 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 10 monclient: shutdown 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 1 -- 10.20.193.46:0/982028568 >> v1:10.20.193.46:6789/0 conn(0x7f595408ddb0 legacy=0x7f595408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 1 -- 10.20.193.46:0/982028568 shutdown_connections 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 1 -- 10.20.193.46:0/982028568 >> 10.20.193.46:0/982028568 conn(0x7f595408f480 msgr2=0x7f595408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 1 -- 10.20.193.46:0/982028568 shutdown_connections 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.259+0000 7f595b15c640 1 -- 10.20.193.46:0/982028568 wait complete. 2026-02-21T01:27:45.278 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: monmap: 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 0.000000 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:created 0.000000 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 librados: starting msgr at 2026-02-21T01:27:45.279 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 librados: starting objecter 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 Processor -- start 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 -- start start 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 librados: setting wanted keys 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 librados: calling monclient init 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: init 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient(hunting): picked mon.noname-b con 0x7f595408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient(hunting): picked mon.noname-c con 0x7f595408d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient(hunting): picked mon.noname-a con 0x7f595408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595412d840 con 0x7f595408ddb0 2026-02-21T01:27:45.280 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595412db20 con 0x7f595408d4d0 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595408c680 con 0x7f595408d8d0 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient(hunting): authenticate will time out at 603.949481s 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f5958ed1640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f595408d4d0 0x7f5954086800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52042/0 (socket says 10.20.193.46:52042) 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f5958ed1640 1 -- 10.20.193.46:0/2039878798 learned_addr learned my addr 10.20.193.46:0/2039878798 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 client.?.objecter ms_handle_connect 0x7f595408d4d0 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053313697 0 0) 0x7f595412db20 con 0x7f595408d4d0 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): my global_id is 4117 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5924003610 con 0x7f595408d4d0 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 client.?.objecter ms_handle_connect 0x7f595408d8d0 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1939636587 0 0) 0x7f5924003610 con 0x7f595408d4d0 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f595412db20 con 0x7f595408d4d0 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5944002db0 con 0x7f595408d4d0 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): dump: 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.282 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697182494 0 0) 0x7f595408c680 con 0x7f595408d8d0 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.283 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient(hunting): my global_id is 4112 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5924003610 con 0x7f595408d8d0 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2884548703 0 0) 0x7f595412db20 con 0x7f595408d4d0 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.43:6790/0 conn(0x7f595408d8d0 legacy=0x7f5954086f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.43:6789/0 conn(0x7f595408ddb0 legacy=0x7f595418ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 monclient: found mon.b 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595405e1b0 con 0x7f595408d4d0 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.284 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 5 monclient: authenticate success, global_id 4117 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: _renew_subs 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f595412d560 con 0x7f595408d4d0 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 client.4117.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: _renew_subs 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5954087620 con 0x7f595408d4d0 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f595b15c640 1 librados: init done 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5944002fc0 con 0x7f595408d4d0 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5944004f70 con 0x7f595408d4d0 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 monclient: dump: 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.286 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f594affd640 4 set_mon_vals no callback set 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f5944005520 con 0x7f595408d4d0 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 541464683 0 0) 0x7f5944006c10 con 0x7f595408d4d0 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 10 client.4117.objecter ms_dispatch2 0x7f5954000b90 osd_map(3..3 src has 1..3) 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 3 client.4117.objecter handle_osd_map got epochs [3,3] > 0 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.260+0000 7f59497fa640 3 client.4117.objecter handle_osd_map decoding full epoch 3 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 20 client.4117.objecter dump_active .. 0 homeless 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f595b15c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f595b15c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f595b15c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595408edd0 con 0x7f595408d4d0 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f5958ed1640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.46:6789/0 conn(0x7f595408d4d0 legacy=0x7f5954086800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-21T01:27:45.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f5958ed1640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.46:6789/0 conn(0x7f595408d4d0 legacy=0x7f5954086800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f5958ed1640 1 --1- 10.20.193.46:0/2039878798 >> v1:10.20.193.46:6789/0 conn(0x7f595408d4d0 0x7f5954086800 :-1 s=OPENED pgs=14 cs=1 l=1).handle_message read tag failed 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f5958ed1640 1 --1- 10.20.193.46:0/2039878798 >> v1:10.20.193.46:6789/0 conn(0x7f595408d4d0 0x7f5954086800 :-1 s=OPENED pgs=14 cs=1 l=1).fault on lossy channel, failing 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: ms_handle_reset current mon v1:10.20.193.46:6789/0 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.46:6789/0 conn(0x7f595408d4d0 legacy=0x7f5954086800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient(hunting): picked mon.c con 0x7f595408d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient(hunting): picked mon.b con 0x7f5924028370 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient(hunting): picked mon.a con 0x7f595408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f595412db20 con 0x7f595408ddb0 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f595412d840 con 0x7f5924028370 2026-02-21T01:27:45.288 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f595408c680 con 0x7f595408d8d0 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 client.4117.objecter ms_handle_connect 0x7f5924028370 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 client.4117.objecter resend_mon_ops 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 client.4117.objecter ms_handle_connect 0x7f595408d8d0 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 client.4117.objecter resend_mon_ops 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252535164 0 0) 0x7f595408c680 con 0x7f595408d8d0 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.43:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f592406e0e0 con 0x7f595408d8d0 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 3364049979 0 0) 0x7f592406e0e0 con 0x7f595408d8d0 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.46:6789/0 conn(0x7f5924028370 legacy=0x7f59240487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.289 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.43:6789/0 conn(0x7f595408ddb0 legacy=0x7f592406a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 monclient: found mon.c 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f592406f1b0 con 0x7f595408d8d0 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595408c680 con 0x7f595408d8d0 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.290 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 client.4117.objecter ms_handle_connect 0x7f595408ddb0 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 client.4117.objecter resend_mon_ops 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5944005d00 con 0x7f595408d8d0 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.261+0000 7f59497fa640 10 monclient: dump: 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.291 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.262+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5944005ea0 con 0x7f595408d8d0 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.262+0000 7f59497fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.262+0000 7f594a7fc640 4 set_mon_vals no callback set 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.262+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f5944006f50 con 0x7f595408d8d0 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.263+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f59440080a0 con 0x7f595408d8d0 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.263+0000 7f59497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.292 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.263+0000 7f59497fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:45.298 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.295+0000 7f595b15c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4207f5e8-3ce8-4f55-bb23-a8605d56d872", "id": 1}] 2026-02-21T01:27:45.298 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.295+0000 7f595b15c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4207f5e8-3ce8-4f55-bb23-a8605d56d872", "id": 1}] 2026-02-21T01:27:45.298 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.295+0000 7f595b15c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.298 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.295+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd new", "uuid": "4207f5e8-3ce8-4f55-bb23-a8605d56d872", "id": 1} v 0) -- 0x7f5954054ff0 con 0x7f595408d8d0 2026-02-21T01:27:45.300 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.297+0000 7f59497fa640 1 -- 10.20.193.46:0/2039878798 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4207f5e8-3ce8-4f55-bb23-a8605d56d872", "id": 1}]=0 v4) ==== 112+0+2 (unknown 1802210586 0 940483276) 0x7f5944007d20 con 0x7f595408d8d0 2026-02-21T01:27:45.300 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.297+0000 7f59497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4207f5e8-3ce8-4f55-bb23-a8605d56d872", "id": 1}] 2026-02-21T01:27:45.300 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.297+0000 7f59497fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:45.301 INFO:teuthology.orchestra.run.trial046.stdout:1 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 10 librados: watch_flush enter 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 10 librados: watch_flush exit 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 20 client.4117.objecter shutdown clearing up homeless session... 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 10 client.4117.objecter successfully canceled tick 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 10 monclient: shutdown 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 >> v1:10.20.193.43:6790/0 conn(0x7f595408d8d0 legacy=0x7f59240269a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 shutdown_connections 2026-02-21T01:27:45.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 >> 10.20.193.46:0/2039878798 conn(0x7f595408f480 msgr2=0x7f59541a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.303 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 shutdown_connections 2026-02-21T01:27:45.303 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 1 -- 10.20.193.46:0/2039878798 wait complete. 2026-02-21T01:27:45.303 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.298+0000 7f595b15c640 1 librados: shutdown 2026-02-21T01:27:45.308 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd new da0c4995-e8bf-480e-876d-be10b4196751 2 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.369+0000 7fb2962b8640 10 monclient: get_monmap_and_config 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.369+0000 7fb2962b8640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.369+0000 7fb2962b8640 10 monclient: monmap: 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:45.371410+0000 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:45.371410+0000 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:45.378 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 1 Processor -- start 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 1 -- start start 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient: init 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient(hunting): picked mon.noname-b con 0x7fb29008ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient(hunting): picked mon.noname-a con 0x7fb29008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient(hunting): picked mon.noname-c con 0x7fb29008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29008a690 con 0x7fb29008d4d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29008b910 con 0x7fb29008d8d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290088ae0 con 0x7fb29008ddb0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb2962b8640 10 monclient(hunting): authenticate will time out at 604.059644s 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb29482e640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7fb29008d8d0 0x7fb29019f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52064/0 (socket says 10.20.193.46:52064) 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb29482e640 1 -- 10.20.193.46:0/516773990 learned_addr learned my addr 10.20.193.46:0/516773990 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269772677 0 0) 0x7fb29008b910 con 0x7fb29008d8d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb28effd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb28effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb28effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb28effd640 10 monclient(hunting): my global_id is 4120 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.370+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb274003610 con 0x7fb29008d8d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107549179 0 0) 0x7fb29008a690 con 0x7fb29008d4d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient(hunting): my global_id is 4119 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb29008b910 con 0x7fb29008d4d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 141293069 0 0) 0x7fb274003610 con 0x7fb29008d8d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 >> v1:10.20.193.43:6790/0 conn(0x7fb29008ddb0 legacy=0x7fb29008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 >> v1:10.20.193.43:6789/0 conn(0x7fb29008d4d0 legacy=0x7fb29017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 monclient: found mon.noname-c 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2901a3ef0 con 0x7fb29008d8d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb284003170 con 0x7fb29008d8d0 2026-02-21T01:27:45.379 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 5 monclient: authenticate success, global_id 4120 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: dump: 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2840033f0 con 0x7fb29008d8d0 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 1 -- 10.20.193.46:0/516773990 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb284003830 con 0x7fb29008d8d0 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb28effd640 10 monclient: dump: 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 4 set_mon_vals no callback set 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 10 monclient: shutdown 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 -- 10.20.193.46:0/516773990 >> v1:10.20.193.46:6789/0 conn(0x7fb29008d8d0 legacy=0x7fb29019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 -- 10.20.193.46:0/516773990 shutdown_connections 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 -- 10.20.193.46:0/516773990 >> 10.20.193.46:0/516773990 conn(0x7fb29008f480 msgr2=0x7fb29008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 -- 10.20.193.46:0/516773990 shutdown_connections 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 -- 10.20.193.46:0/516773990 wait complete. 2026-02-21T01:27:45.380 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 10 monclient: monmap: 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 0.000000 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:created 0.000000 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 librados: starting msgr at 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 librados: starting objecter 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.371+0000 7fb2962b8640 1 Processor -- start 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 -- start start 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 librados: setting wanted keys 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 librados: calling monclient init 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient: init 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient(hunting): picked mon.noname-c con 0x7fb29008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient(hunting): picked mon.noname-a con 0x7fb29008d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient(hunting): picked mon.noname-b con 0x7fb29008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29013a4e0 con 0x7fb29008d8d0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290105b90 con 0x7fb29008ddb0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29005e1b0 con 0x7fb29008d4d0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient(hunting): authenticate will time out at 604.061264s 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb29482e640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7fb29008ddb0 0x7fb29019c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52074/0 (socket says 10.20.193.46:52074) 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb29482e640 1 -- 10.20.193.46:0/1465294549 learned_addr learned my addr 10.20.193.46:0/1465294549 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 client.?.objecter ms_handle_connect 0x7fb29008ddb0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917063539 0 0) 0x7fb290105b90 con 0x7fb29008ddb0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): my global_id is 4123 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb260003610 con 0x7fb29008ddb0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 client.?.objecter ms_handle_connect 0x7fb29008d8d0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3128204526 0 0) 0x7fb260003610 con 0x7fb29008ddb0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb290105b90 con 0x7fb29008ddb0 2026-02-21T01:27:45.381 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb284003080 con 0x7fb29008ddb0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): dump: 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2220910789 0 0) 0x7fb290105b90 con 0x7fb29008ddb0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 >> v1:10.20.193.43:6790/0 conn(0x7fb29008d4d0 legacy=0x7fb29011dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 >> v1:10.20.193.43:6789/0 conn(0x7fb29008d8d0 legacy=0x7fb29019a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 monclient: found mon.b 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb290124c80 con 0x7fb29008ddb0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 5 monclient: authenticate success, global_id 4123 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient: _renew_subs 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb290127040 con 0x7fb29008ddb0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 client.4123.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient: _renew_subs 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2901259c0 con 0x7fb29008ddb0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb2962b8640 1 librados: init done 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2840033f0 con 0x7fb29008ddb0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb284005060 con 0x7fb29008ddb0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28e7fc640 4 set_mon_vals no callback set 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 monclient: dump: 2026-02-21T01:27:45.382 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fb284005610 con 0x7fb29008ddb0 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 4048091480 0 0) 0x7fb284005d50 con 0x7fb29008ddb0 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 10 client.4123.objecter ms_dispatch2 0x7fb290000b90 osd_map(4..4 src has 1..4) 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 3 client.4123.objecter handle_osd_map got epochs [4,4] > 0 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 3 client.4123.objecter handle_osd_map decoding full epoch 4 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.372+0000 7fb28cff9640 20 client.4123.objecter dump_active .. 0 homeless 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.373+0000 7fb2962b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.373+0000 7fb2962b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.373+0000 7fb2962b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.373+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29008edd0 con 0x7fb29008ddb0 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.374+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fb290127040 con 0x7fb29008ddb0 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.374+0000 7fb28cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.383 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.374+0000 7fb28cff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:45.409 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.406+0000 7fb2962b8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "da0c4995-e8bf-480e-876d-be10b4196751", "id": 2}] 2026-02-21T01:27:45.409 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.406+0000 7fb2962b8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "da0c4995-e8bf-480e-876d-be10b4196751", "id": 2}] 2026-02-21T01:27:45.409 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.406+0000 7fb2962b8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.409 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.406+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "osd new", "uuid": "da0c4995-e8bf-480e-876d-be10b4196751", "id": 2} v 0) -- 0x7fb2901a10d0 con 0x7fb29008ddb0 2026-02-21T01:27:45.410 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.408+0000 7fb28cff9640 1 -- 10.20.193.46:0/1465294549 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da0c4995-e8bf-480e-876d-be10b4196751", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2953798457 0 216599125) 0x7fb284005b20 con 0x7fb29008ddb0 2026-02-21T01:27:45.411 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.408+0000 7fb28cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "da0c4995-e8bf-480e-876d-be10b4196751", "id": 2}] 2026-02-21T01:27:45.411 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.408+0000 7fb28cff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:45.411 INFO:teuthology.orchestra.run.trial046.stdout:2 2026-02-21T01:27:45.412 INFO:tasks.ceph.mgr.x.trial046.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-21T01:27:45.412 INFO:tasks.ceph.mgr.x.trial046.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-21T01:27:45.412 INFO:tasks.ceph.mgr.x.trial046.stderr: from numpy import show_config as show_numpy_config 2026-02-21T01:27:45.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 10 librados: watch_flush enter 2026-02-21T01:27:45.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 10 librados: watch_flush exit 2026-02-21T01:27:45.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 20 client.4123.objecter shutdown clearing up homeless session... 2026-02-21T01:27:45.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 10 client.4123.objecter successfully canceled tick 2026-02-21T01:27:45.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 10 monclient: shutdown 2026-02-21T01:27:45.413 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 >> v1:10.20.193.46:6789/0 conn(0x7fb29008ddb0 legacy=0x7fb29019c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 shutdown_connections 2026-02-21T01:27:45.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 >> 10.20.193.46:0/1465294549 conn(0x7fb29008f480 msgr2=0x7fb2901a2740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 shutdown_connections 2026-02-21T01:27:45.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 1 -- 10.20.193.46:0/1465294549 wait complete. 2026-02-21T01:27:45.414 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.409+0000 7fb2962b8640 1 librados: shutdown 2026-02-21T01:27:45.418 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd new 2cb6a730-2373-4354-904c-57509d260325 3 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.477+0000 7f9af9b83640 10 monclient: get_monmap_and_config 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.477+0000 7f9af9b83640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.477+0000 7f9af9b83640 10 monclient: monmap: 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:45.479223+0000 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:45.479223+0000 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:45.480 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.487 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 1 Processor -- start 2026-02-21T01:27:45.487 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 1 -- start start 2026-02-21T01:27:45.487 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient: init 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient(hunting): picked mon.noname-b con 0x7f9af408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient(hunting): picked mon.noname-c con 0x7f9af408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient(hunting): picked mon.noname-a con 0x7f9af408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af408a690 con 0x7f9af408d8d0 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af408b910 con 0x7f9af408d4d0 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af4088ae0 con 0x7f9af408ddb0 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient(hunting): authenticate will time out at 604.167492s 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af2ffd640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f9af408d4d0 0x7f9af417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52076/0 (socket says 10.20.193.46:52076) 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af2ffd640 1 -- 10.20.193.46:0/2800585433 learned_addr learned my addr 10.20.193.46:0/2800585433 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958004078 0 0) 0x7f9af408b910 con 0x7f9af408d4d0 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient(hunting): my global_id is 4126 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad8003610 con 0x7f9af408d4d0 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1062226937 0 0) 0x7f9ad8003610 con 0x7f9af408d4d0 2026-02-21T01:27:45.489 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 >> v1:10.20.193.43:6790/0 conn(0x7f9af408ddb0 legacy=0x7f9af408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 >> v1:10.20.193.43:6789/0 conn(0x7f9af408d8d0 legacy=0x7f9af419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 monclient: found mon.noname-c 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af41a3ef0 con 0x7f9af408d4d0 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9ae4002df0 con 0x7f9af408d4d0 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.490 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: dump: 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.491 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 5 monclient: authenticate success, global_id 4126 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ae4003070 con 0x7f9af408d4d0 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af9b83640 4 set_mon_vals no callback set 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 1 -- 10.20.193.46:0/2800585433 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9ae4003470 con 0x7f9af408d4d0 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.478+0000 7f9af27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af27fc640 10 monclient: dump: 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.492 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 10 monclient: shutdown 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 -- 10.20.193.46:0/2800585433 >> v1:10.20.193.46:6789/0 conn(0x7f9af408d4d0 legacy=0x7f9af417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 -- 10.20.193.46:0/2800585433 shutdown_connections 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 -- 10.20.193.46:0/2800585433 >> 10.20.193.46:0/2800585433 conn(0x7f9af408f480 msgr2=0x7f9af408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.493 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 -- 10.20.193.46:0/2800585433 shutdown_connections 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 -- 10.20.193.46:0/2800585433 wait complete. 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 10 monclient: monmap: 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 0.000000 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:created 0.000000 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:45.494 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 librados: starting msgr at 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 librados: starting objecter 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 Processor -- start 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 -- start start 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 librados: setting wanted keys 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 1 librados: calling monclient init 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.479+0000 7f9af9b83640 10 monclient: init 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient(hunting): picked mon.noname-c con 0x7f9af408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient(hunting): picked mon.noname-b con 0x7f9af408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient(hunting): picked mon.noname-a con 0x7f9af408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.495 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af410b010 con 0x7f9af408ddb0 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af410a770 con 0x7f9af408d8d0 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af410aa50 con 0x7f9af408d4d0 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient(hunting): authenticate will time out at 604.169242s 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af2ffd640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f9af408d8d0 0x7f9af418df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52086/0 (socket says 10.20.193.46:52086) 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af2ffd640 1 -- 10.20.193.46:0/4086768139 learned_addr learned my addr 10.20.193.46:0/4086768139 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 client.?.objecter ms_handle_connect 0x7f9af408d8d0 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677173593 0 0) 0x7f9af410a770 con 0x7f9af408d8d0 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): my global_id is 4129 2026-02-21T01:27:45.496 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ac4003610 con 0x7f9af408d8d0 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 client.?.objecter ms_handle_connect 0x7f9af408ddb0 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3494639943 0 0) 0x7f9ac4003610 con 0x7f9af408d8d0 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9af410a770 con 0x7f9af408d8d0 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 client.?.objecter ms_handle_connect 0x7f9af408d4d0 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9ae4002b60 con 0x7f9af408d8d0 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): dump: 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.497 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471501791 0 0) 0x7f9af410b010 con 0x7f9af408ddb0 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient(hunting): my global_id is 4128 2026-02-21T01:27:45.498 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ac4003610 con 0x7f9af408ddb0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2471747391 0 0) 0x7f9af410a770 con 0x7f9af408d8d0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 >> v1:10.20.193.43:6790/0 conn(0x7f9af408d4d0 legacy=0x7f9af411b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 >> v1:10.20.193.43:6789/0 conn(0x7f9af408ddb0 legacy=0x7f9af418f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 monclient: found mon.b 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af40881c0 con 0x7f9af408d8d0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 5 monclient: authenticate success, global_id 4129 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient: _renew_subs 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9af4087ef0 con 0x7f9af408d8d0 2026-02-21T01:27:45.499 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ae4002eb0 con 0x7f9af408d8d0 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9ae4004ec0 con 0x7f9af408d8d0 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 client.4129.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af1ffb640 4 set_mon_vals no callback set 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 monclient: dump: 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.500 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient: _renew_subs 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9af405cc80 con 0x7f9af408d8d0 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9af9b83640 1 librados: init done 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f9ae4005470 con 0x7f9af408d8d0 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 2991028577 0 0) 0x7f9ae4006b20 con 0x7f9af408d8d0 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 10 client.4129.objecter ms_dispatch2 0x7f9af4000b90 osd_map(5..5 src has 1..5) 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 3 client.4129.objecter handle_osd_map got epochs [5,5] > 0 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 3 client.4129.objecter handle_osd_map decoding full epoch 5 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.480+0000 7f9acffff640 20 client.4129.objecter dump_active .. 0 homeless 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.481+0000 7f9af9b83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.481+0000 7f9af9b83640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.481+0000 7f9af9b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.501 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.481+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af408edd0 con 0x7f9af408d8d0 2026-02-21T01:27:45.502 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.482+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f9ae4006690 con 0x7f9af408d8d0 2026-02-21T01:27:45.502 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.482+0000 7f9acffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.502 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.482+0000 7f9acffff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:45.518 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.515+0000 7f9af9b83640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "2cb6a730-2373-4354-904c-57509d260325", "id": 3}] 2026-02-21T01:27:45.518 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.515+0000 7f9af9b83640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "2cb6a730-2373-4354-904c-57509d260325", "id": 3}] 2026-02-21T01:27:45.518 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.515+0000 7f9af9b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.518 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.515+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "osd new", "uuid": "2cb6a730-2373-4354-904c-57509d260325", "id": 3} v 0) -- 0x7f9af408c910 con 0x7f9af408d8d0 2026-02-21T01:27:45.519 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9acffff640 1 -- 10.20.193.46:0/4086768139 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2cb6a730-2373-4354-904c-57509d260325", "id": 3}]=0 v6) ==== 112+0+2 (unknown 4227690527 0 525046306) 0x7f9ae4005790 con 0x7f9af408d8d0 2026-02-21T01:27:45.520 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9acffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "2cb6a730-2373-4354-904c-57509d260325", "id": 3}] 2026-02-21T01:27:45.520 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9acffff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:45.520 INFO:teuthology.orchestra.run.trial046.stdout:3 2026-02-21T01:27:45.521 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 10 librados: watch_flush enter 2026-02-21T01:27:45.521 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 10 librados: watch_flush exit 2026-02-21T01:27:45.521 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 20 client.4129.objecter shutdown clearing up homeless session... 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 10 client.4129.objecter successfully canceled tick 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 10 monclient: shutdown 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 >> v1:10.20.193.46:6789/0 conn(0x7f9af408d8d0 legacy=0x7f9af418df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 shutdown_connections 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 >> 10.20.193.46:0/4086768139 conn(0x7f9af408f480 msgr2=0x7f9af4057900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.517+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 shutdown_connections 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.518+0000 7f9af9b83640 1 -- 10.20.193.46:0/4086768139 wait complete. 2026-02-21T01:27:45.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.518+0000 7f9af9b83640 1 librados: shutdown 2026-02-21T01:27:45.528 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd new 22624587-71c2-4992-b8bb-6ff8f9fad066 4 2026-02-21T01:27:45.601 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.590+0000 7f7a2a646640 10 monclient: get_monmap_and_config 2026-02-21T01:27:45.601 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.590+0000 7f7a2a646640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.601 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.590+0000 7f7a2a646640 10 monclient: monmap: 2026-02-21T01:27:45.601 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.601 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.601 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:45.591912+0000 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:45.591912+0000 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.590+0000 7f7a2a646640 1 Processor -- start 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.590+0000 7f7a2a646640 1 -- start start 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.590+0000 7f7a2a646640 10 monclient: init 2026-02-21T01:27:45.602 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient(hunting): picked mon.noname-b con 0x7f7a2408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient(hunting): picked mon.noname-a con 0x7f7a2408d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient(hunting): picked mon.noname-c con 0x7f7a2408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2408a690 con 0x7f7a2408d4d0 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2408b910 con 0x7f7a2408d8d0 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a24088ae0 con 0x7f7a2408ddb0 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient(hunting): authenticate will time out at 604.280205s 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a28bbc640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f7a2408d8d0 0x7f7a2419f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52102/0 (socket says 10.20.193.46:52102) 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a28bbc640 1 -- 10.20.193.46:0/1879288290 learned_addr learned my addr 10.20.193.46:0/1879288290 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.603 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2795738842 0 0) 0x7f7a2408b910 con 0x7f7a2408d8d0 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient(hunting): my global_id is 4132 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a08003610 con 0x7f7a2408d8d0 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3206128964 0 0) 0x7f7a08003610 con 0x7f7a2408d8d0 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 >> v1:10.20.193.43:6790/0 conn(0x7f7a2408ddb0 legacy=0x7f7a2408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 >> v1:10.20.193.43:6789/0 conn(0x7f7a2408d4d0 legacy=0x7f7a2417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 monclient: found mon.noname-c 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.604 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a241a3ef0 con 0x7f7a2408d8d0 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a18003170 con 0x7f7a2408d8d0 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: dump: 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.605 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 5 monclient: authenticate success, global_id 4132 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a18003470 con 0x7f7a2408d8d0 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 1 -- 10.20.193.46:0/1879288290 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a180038b0 con 0x7f7a2408d8d0 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.606 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a22ffd640 10 monclient: dump: 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.607 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 4 set_mon_vals no callback set 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 10 monclient: shutdown 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 1 -- 10.20.193.46:0/1879288290 >> v1:10.20.193.46:6789/0 conn(0x7f7a2408d8d0 legacy=0x7f7a2419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 1 -- 10.20.193.46:0/1879288290 shutdown_connections 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.591+0000 7f7a2a646640 1 -- 10.20.193.46:0/1879288290 >> 10.20.193.46:0/1879288290 conn(0x7f7a2408f480 msgr2=0x7f7a2408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 -- 10.20.193.46:0/1879288290 shutdown_connections 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 -- 10.20.193.46:0/1879288290 wait complete. 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient: monmap: 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.608 INFO:teuthology.orchestra.run.trial046.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 0.000000 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:created 0.000000 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 librados: starting msgr at 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 librados: starting objecter 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 Processor -- start 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 -- start start 2026-02-21T01:27:45.609 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 librados: setting wanted keys 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 librados: calling monclient init 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient: init 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient(hunting): picked mon.noname-b con 0x7f7a2408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient(hunting): picked mon.noname-a con 0x7f7a2408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient(hunting): picked mon.noname-c con 0x7f7a2408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2410dc80 con 0x7f7a2408d8d0 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a24087380 con 0x7f7a2408d4d0 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2410d0f0 con 0x7f7a2408ddb0 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.610 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.592+0000 7f7a2a646640 10 monclient(hunting): authenticate will time out at 604.281951s 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a23fff640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7f7a2408d4d0 0x7f7a24086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52110/0 (socket says 10.20.193.46:52110) 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a23fff640 1 -- 10.20.193.46:0/2806223881 learned_addr learned my addr 10.20.193.46:0/2806223881 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 client.?.objecter ms_handle_connect 0x7f7a2408d4d0 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685822991 0 0) 0x7f7a24087380 con 0x7f7a2408d4d0 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): my global_id is 4135 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79f4003610 con 0x7f7a2408d4d0 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 client.?.objecter ms_handle_connect 0x7f7a2408ddb0 2026-02-21T01:27:45.611 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 client.?.objecter ms_handle_connect 0x7f7a2408d8d0 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972851981 0 0) 0x7f7a2410d0f0 con 0x7f7a2408ddb0 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): my global_id is 4124 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a24087380 con 0x7f7a2408ddb0 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3450226076 0 0) 0x7f79f4003610 con 0x7f7a2408d4d0 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a2410d0f0 con 0x7f7a2408d4d0 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811930832 0 0) 0x7f7a2410dc80 con 0x7f7a2408d8d0 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.612 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): my global_id is 4134 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79f4003610 con 0x7f7a2408d8d0 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a100030c0 con 0x7f7a2408d4d0 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.613 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2832576477 0 0) 0x7f7a2410d0f0 con 0x7f7a2408d4d0 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 >> v1:10.20.193.43:6790/0 conn(0x7f7a2408ddb0 legacy=0x7f7a2419b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 >> v1:10.20.193.43:6789/0 conn(0x7f7a2408d8d0 legacy=0x7f7a24086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 monclient: found mon.b 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.614 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2410df60 con 0x7f7a2408d4d0 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 5 monclient: authenticate success, global_id 4135 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 monclient: _renew_subs 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a24057210 con 0x7f7a2408d4d0 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 client.4135.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 monclient: _renew_subs 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a2410e380 con 0x7f7a2408d4d0 2026-02-21T01:27:45.615 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 1 librados: init done 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a10003470 con 0x7f7a2408d4d0 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a10003b50 con 0x7f7a2408d4d0 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 monclient: dump: 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.616 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a227fc640 4 set_mon_vals no callback set 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7a10004180 con 0x7f7a2408d4d0 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 3697402532 0 0) 0x7f7a100044a0 con 0x7f7a2408d4d0 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 10 client.4135.objecter ms_dispatch2 0x7f7a24000b90 osd_map(6..6 src has 1..6) 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 3 client.4135.objecter handle_osd_map got epochs [6,6] > 0 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 3 client.4135.objecter handle_osd_map decoding full epoch 6 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a20ff9640 20 client.4135.objecter dump_active .. 0 homeless 2026-02-21T01:27:45.617 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.593+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2408e180 con 0x7f7a2408d4d0 2026-02-21T01:27:45.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.594+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f7a2408e180 con 0x7f7a2408d4d0 2026-02-21T01:27:45.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.594+0000 7f7a20ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.594+0000 7f7a20ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:45.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.629+0000 7f7a2a646640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "22624587-71c2-4992-b8bb-6ff8f9fad066", "id": 4}] 2026-02-21T01:27:45.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.629+0000 7f7a2a646640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "22624587-71c2-4992-b8bb-6ff8f9fad066", "id": 4}] 2026-02-21T01:27:45.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.629+0000 7f7a2a646640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.632 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.629+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "osd new", "uuid": "22624587-71c2-4992-b8bb-6ff8f9fad066", "id": 4} v 0) -- 0x7f7a2405e190 con 0x7f7a2408d4d0 2026-02-21T01:27:45.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a20ff9640 1 -- 10.20.193.46:0/2806223881 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22624587-71c2-4992-b8bb-6ff8f9fad066", "id": 4}]=0 v7) ==== 112+0+2 (unknown 3206981545 0 1697012583) 0x7f7a10006760 con 0x7f7a2408d4d0 2026-02-21T01:27:45.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a20ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "22624587-71c2-4992-b8bb-6ff8f9fad066", "id": 4}] 2026-02-21T01:27:45.633 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a20ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:45.634 INFO:teuthology.orchestra.run.trial046.stdout:4 2026-02-21T01:27:45.635 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 10 librados: watch_flush enter 2026-02-21T01:27:45.635 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 10 librados: watch_flush exit 2026-02-21T01:27:45.635 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 20 client.4135.objecter shutdown clearing up homeless session... 2026-02-21T01:27:45.635 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 10 client.4135.objecter successfully canceled tick 2026-02-21T01:27:45.635 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 10 monclient: shutdown 2026-02-21T01:27:45.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 >> v1:10.20.193.46:6789/0 conn(0x7f7a2408d4d0 legacy=0x7f7a24086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 shutdown_connections 2026-02-21T01:27:45.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 >> 10.20.193.46:0/2806223881 conn(0x7f7a2408f480 msgr2=0x7f7a24058660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 shutdown_connections 2026-02-21T01:27:45.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 1 -- 10.20.193.46:0/2806223881 wait complete. 2026-02-21T01:27:45.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.631+0000 7f7a2a646640 1 librados: shutdown 2026-02-21T01:27:45.641 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd new b7f8c29f-504c-4cfe-b959-03fe02b39f69 5 2026-02-21T01:27:45.715 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.704+0000 7ff9b8d2e640 10 monclient: get_monmap_and_config 2026-02-21T01:27:45.715 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.704+0000 7ff9b8d2e640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.715 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.704+0000 7ff9b8d2e640 10 monclient: monmap: 2026-02-21T01:27:45.715 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.715 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.715 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:45.706458+0000 2026-02-21T01:27:45.715 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:45.706458+0000 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 1 Processor -- start 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 1 -- start start 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient: init 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.716 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient(hunting): picked mon.noname-c con 0x7ff9b408ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient(hunting): picked mon.noname-b con 0x7ff9b408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient(hunting): picked mon.noname-a con 0x7ff9b408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b408a690 con 0x7ff9b408d8d0 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b408b910 con 0x7ff9b408ddb0 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b4088ae0 con 0x7ff9b408d4d0 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b8d2e640 10 monclient(hunting): authenticate will time out at 604.394695s 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b2575640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7ff9b408ddb0 0x7ff9b408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52126/0 (socket says 10.20.193.46:52126) 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b2575640 1 -- 10.20.193.46:0/848494818 learned_addr learned my addr 10.20.193.46:0/848494818 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.717 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046853383 0 0) 0x7ff9b408b910 con 0x7ff9b408ddb0 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b1573640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b1573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b1573640 10 monclient(hunting): my global_id is 4138 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.705+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9a0003610 con 0x7ff9b408ddb0 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4043109876 0 0) 0x7ff9a0003610 con 0x7ff9b408ddb0 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 >> v1:10.20.193.43:6790/0 conn(0x7ff9b408d4d0 legacy=0x7ff9b417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 >> v1:10.20.193.43:6789/0 conn(0x7ff9b408d8d0 legacy=0x7ff9b419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 monclient: found mon.noname-c 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.718 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b41a3ef0 con 0x7ff9b408ddb0 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff9a8002df0 con 0x7ff9b408ddb0 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: dump: 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.719 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 5 monclient: authenticate success, global_id 4138 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9a80030f0 con 0x7ff9b408ddb0 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 1 -- 10.20.193.46:0/848494818 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff9a8003530 con 0x7ff9b408ddb0 2026-02-21T01:27:45.720 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b1573640 10 monclient: dump: 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.721 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 4 set_mon_vals no callback set 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 10 monclient: shutdown 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/848494818 >> v1:10.20.193.46:6789/0 conn(0x7ff9b408ddb0 legacy=0x7ff9b408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/848494818 shutdown_connections 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/848494818 >> 10.20.193.46:0/848494818 conn(0x7ff9b408f480 msgr2=0x7ff9b408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/848494818 shutdown_connections 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/848494818 wait complete. 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.706+0000 7ff9b8d2e640 10 monclient: monmap: 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:epoch 0 2026-02-21T01:27:45.722 INFO:teuthology.orchestra.run.trial046.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 0.000000 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:created 0.000000 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 librados: starting msgr at 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 librados: starting objecter 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 Processor -- start 2026-02-21T01:27:45.723 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 -- start start 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 librados: setting wanted keys 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 librados: calling monclient init 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient: init 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient(hunting): picked mon.noname-a con 0x7ff9b408d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient(hunting): picked mon.noname-b con 0x7ff9b408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient(hunting): picked mon.noname-c con 0x7ff9b408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b4108da0 con 0x7ff9b408d4d0 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b405e1b0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b41072e0 con 0x7ff9b408ddb0 2026-02-21T01:27:45.724 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient(hunting): authenticate will time out at 604.396441s 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b1d74640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x7ff9b408d8d0 0x7ff9b418b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:52128/0 (socket says 10.20.193.46:52128) 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b1d74640 1 -- 10.20.193.46:0/1149458196 learned_addr learned my addr 10.20.193.46:0/1149458196 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 client.?.objecter ms_handle_connect 0x7ff9b408d8d0 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513061418 0 0) 0x7ff9b405e1b0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): my global_id is 4141 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff980003610 con 0x7ff9b408d8d0 2026-02-21T01:27:45.725 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3424989368 0 0) 0x7ff980003610 con 0x7ff9b408d8d0 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9b405e1b0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 client.?.objecter ms_handle_connect 0x7ff9b408ddb0 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff99c0040d0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): dump: 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.726 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 client.?.objecter ms_handle_connect 0x7ff9b408d4d0 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.727 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2399194137 0 0) 0x7ff9b405e1b0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 >> v1:10.20.193.43:6790/0 conn(0x7ff9b408ddb0 legacy=0x7ff9b418cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 >> v1:10.20.193.43:6789/0 conn(0x7ff9b408d4d0 legacy=0x7ff9b411dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 monclient: found mon.b 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4109640 con 0x7ff9b408d8d0 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.728 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 5 monclient: authenticate success, global_id 4141 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient: _renew_subs 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b411e3b0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 client.4141.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient: _renew_subs 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9b4108020 con 0x7ff9b408d8d0 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b8d2e640 1 librados: init done 2026-02-21T01:27:45.729 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff99c0044a0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff99c0029c0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff9b0d72640 4 set_mon_vals no callback set 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 monclient: dump: 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:epoch 1 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.730 INFO:teuthology.orchestra.run.trial046.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:election_strategy: 1 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7ff99c002fe0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 2380183441 0 0) 0x7ff99c006d30 con 0x7ff9b408d8d0 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 10 client.4141.objecter ms_dispatch2 0x7ff9b4000b90 osd_map(7..7 src has 1..7) 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 3 client.4141.objecter handle_osd_map got epochs [7,7] > 0 2026-02-21T01:27:45.731 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 3 client.4141.objecter handle_osd_map decoding full epoch 7 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.707+0000 7ff99affd640 20 client.4141.objecter dump_active .. 0 homeless 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.708+0000 7ff9b8d2e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.708+0000 7ff9b8d2e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.708+0000 7ff9b8d2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.708+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b408edd0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.709+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7ff99c005ff0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.709+0000 7ff99affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.709+0000 7ff99affd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:45.744 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.742+0000 7ff9b8d2e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b7f8c29f-504c-4cfe-b959-03fe02b39f69", "id": 5}] 2026-02-21T01:27:45.745 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.742+0000 7ff9b8d2e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b7f8c29f-504c-4cfe-b959-03fe02b39f69", "id": 5}] 2026-02-21T01:27:45.745 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.742+0000 7ff9b8d2e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:45.745 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.742+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b7f8c29f-504c-4cfe-b959-03fe02b39f69", "id": 5} v 0) -- 0x7ff9b408b7a0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.746 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff99affd640 1 -- 10.20.193.46:0/1149458196 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7f8c29f-504c-4cfe-b959-03fe02b39f69", "id": 5}]=0 v8) ==== 112+0+2 (unknown 545146376 0 1988412176) 0x7ff99c0067c0 con 0x7ff9b408d8d0 2026-02-21T01:27:45.747 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff99affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b7f8c29f-504c-4cfe-b959-03fe02b39f69", "id": 5}] 2026-02-21T01:27:45.747 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff99affd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:45.747 INFO:teuthology.orchestra.run.trial046.stdout:5 2026-02-21T01:27:45.748 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff9b8d2e640 10 librados: watch_flush enter 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff9b8d2e640 10 librados: watch_flush exit 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff9b8d2e640 20 client.4141.objecter shutdown clearing up homeless session... 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff9b8d2e640 10 client.4141.objecter successfully canceled tick 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff9b8d2e640 10 monclient: shutdown 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff9b8d2e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.744+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 >> v1:10.20.193.46:6789/0 conn(0x7ff9b408d8d0 legacy=0x7ff9b418b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.745+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 shutdown_connections 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.745+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 >> 10.20.193.46:0/1149458196 conn(0x7ff9b408f480 msgr2=0x7ff9b411f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.745+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 shutdown_connections 2026-02-21T01:27:45.749 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.745+0000 7ff9b8d2e640 1 -- 10.20.193.46:0/1149458196 wait complete. 2026-02-21T01:27:45.750 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-21T01:27:45.745+0000 7ff9b8d2e640 1 librados: shutdown 2026-02-21T01:27:45.754 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-21T01:27:45.754 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-21T01:27:45.756 INFO:tasks.ceph.osd.0:Started 2026-02-21T01:27:45.756 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-21T01:27:45.756 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-21T01:27:45.759 INFO:tasks.ceph.osd.1:Started 2026-02-21T01:27:45.759 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-21T01:27:45.759 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-21T01:27:45.761 INFO:tasks.ceph.osd.2:Started 2026-02-21T01:27:45.761 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-21T01:27:45.761 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-21T01:27:45.763 INFO:tasks.ceph.osd.3:Started 2026-02-21T01:27:45.763 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-21T01:27:45.763 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-21T01:27:45.765 INFO:tasks.ceph.osd.4:Started 2026-02-21T01:27:45.765 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-21T01:27:45.766 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-21T01:27:45.767 INFO:tasks.ceph.osd.5:Started 2026-02-21T01:27:45.768 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-21T01:27:45.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.835+0000 7f7cbe533640 10 monclient: get_monmap_and_config 2026-02-21T01:27:45.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.835+0000 7f7cbe533640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.835+0000 7f7cbe533640 10 monclient: monmap: 2026-02-21T01:27:45.836 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:45.835608+0000 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:45.835608+0000 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:45.837 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:45.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.835+0000 7f7cbe533640 1 Processor -- start 2026-02-21T01:27:45.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.835+0000 7f7cbe533640 1 -- start start 2026-02-21T01:27:45.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.835+0000 7f7cbe533640 10 monclient: init 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.835+0000 7f7cbe533640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient(hunting): picked mon.noname-c con 0x7f7cb8090280 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient(hunting): picked mon.noname-b con 0x7f7cb813f470 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient(hunting): picked mon.noname-a con 0x7f7cb81819e0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb8090650 con 0x7f7cb81819e0 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb8058be0 con 0x7f7cb8090280 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb80909b0 con 0x7f7cb813f470 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient(hunting): authenticate will time out at 597.541066s 2026-02-21T01:27:45.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbcaa9640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f7cb81819e0 0x7f7cb81a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:35830/0 (socket says 10.20.193.43:35830) 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbcaa9640 1 -- 10.20.193.43:0/3388402998 learned_addr learned my addr 10.20.193.43:0/3388402998 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb77fe640 1 --1- 10.20.193.43:0/3388402998 >> v1:10.20.193.43:6790/0 conn(0x7f7cb813f470 0x7f7cb81802c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:46690/0 (socket says 10.20.193.43:46690) 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935186040 0 0) 0x7f7cb8090650 con 0x7f7cb81819e0 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): my global_id is 4161 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c9c003610 con 0x7f7cb81819e0 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464981810 0 0) 0x7f7cb80909b0 con 0x7f7cb813f470 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient(hunting): my global_id is 4145 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb8090650 con 0x7f7cb813f470 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4173663204 0 0) 0x7f7c9c003610 con 0x7f7cb81819e0 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 >> v1:10.20.193.43:6790/0 conn(0x7f7cb813f470 legacy=0x7f7cb81802c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 >> v1:10.20.193.46:6789/0 conn(0x7f7cb8090280 legacy=0x7f7cb80584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 monclient: found mon.noname-a 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb808da00 con 0x7f7cb81819e0 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cac003170 con 0x7f7cb81819e0 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: dump: 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:45.850 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 5 monclient: authenticate success, global_id 4161 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cac0033f0 con 0x7f7cb81819e0 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 1 -- 10.20.193.43:0/3388402998 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cac003830 con 0x7f7cb81819e0 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:45.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cb6ffd640 10 monclient: dump: 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 4 set_mon_vals no callback set 2026-02-21T01:27:45.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 10 monclient: shutdown 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- 10.20.193.43:0/3388402998 >> v1:10.20.193.43:6789/0 conn(0x7f7cb81819e0 legacy=0x7f7cb81a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- 10.20.193.43:0/3388402998 shutdown_connections 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- 10.20.193.43:0/3388402998 >> 10.20.193.43:0/3388402998 conn(0x7f7cb8091c20 msgr2=0x7f7cb808de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- 10.20.193.43:0/3388402998 shutdown_connections 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.836+0000 7f7cbe533640 1 -- 10.20.193.43:0/3388402998 wait complete. 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient: build_initial_monmap 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient: monmap: 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:45.853 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 librados: starting msgr at 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 librados: starting objecter 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 Processor -- start 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 -- start start 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 librados: setting wanted keys 2026-02-21T01:27:45.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 librados: calling monclient init 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient: init 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient(hunting): picked mon.noname-c con 0x7f7cb8090280 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient(hunting): picked mon.noname-b con 0x7f7cb813f470 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient(hunting): picked mon.noname-a con 0x7f7cb81819e0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb81817d0 con 0x7f7cb81819e0 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb810ae70 con 0x7f7cb813f470 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb8128f20 con 0x7f7cb8090280 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbe533640 10 monclient(hunting): authenticate will time out at 597.542708s 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb7fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f7cb8090280 0x7f7cb813dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:46700/0 (socket says 10.20.193.43:46700) 2026-02-21T01:27:45.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cbcaa9640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f7cb81819e0 0x7f7cb81810c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:35838/0 (socket says 10.20.193.43:35838) 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb7fff640 1 -- 10.20.193.43:0/2116482477 learned_addr learned my addr 10.20.193.43:0/2116482477 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 client.?.objecter ms_handle_connect 0x7f7cb8090280 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 client.?.objecter ms_handle_connect 0x7f7cb81819e0 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576690592 0 0) 0x7f7cb8128f20 con 0x7f7cb8090280 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): my global_id is 4148 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c88003610 con 0x7f7cb8090280 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516063628 0 0) 0x7f7cb81817d0 con 0x7f7cb81819e0 2026-02-21T01:27:45.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 monclient(hunting): my global_id is 4164 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb8128f20 con 0x7f7cb81819e0 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 client.?.objecter ms_handle_connect 0x7f7cb813f470 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.837+0000 7f7cb4ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522000917 0 0) 0x7f7cb810ae70 con 0x7f7cb813f470 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): my global_id is 4153 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb81817d0 con 0x7f7cb813f470 2026-02-21T01:27:45.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3070323843 0 0) 0x7f7c88003610 con 0x7f7cb8090280 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cb810ae70 con 0x7f7cb8090280 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ca40040d0 con 0x7f7cb8090280 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:45.858 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2344456915 0 0) 0x7f7cb8128f20 con 0x7f7cb81819e0 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c88003610 con 0x7f7cb81819e0 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cac003080 con 0x7f7cb81819e0 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:45.859 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3258684167 0 0) 0x7f7cb810ae70 con 0x7f7cb8090280 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 >> v1:10.20.193.46:6789/0 conn(0x7f7cb813f470 legacy=0x7f7cb8128810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 >> v1:10.20.193.43:6789/0 conn(0x7f7cb81819e0 legacy=0x7f7cb81810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 monclient: found mon.c 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb810c930 con 0x7f7cb8090280 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 5 monclient: authenticate success, global_id 4148 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 monclient: _renew_subs 2026-02-21T01:27:45.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb810cc10 con 0x7f7cb8090280 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 client.4148.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 monclient: _renew_subs 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cb8115770 con 0x7f7cb8090280 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 1 librados: init done 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ca4004270 con 0x7f7cb8090280 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ca4002930 con 0x7f7cb8090280 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 monclient: dump: 2026-02-21T01:27:45.862 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb67fc640 4 set_mon_vals no callback set 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7ca4002ee0 con 0x7f7cb8090280 2026-02-21T01:27:45.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 1907901852 0 0) 0x7f7ca4006dc0 con 0x7f7cb8090280 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 10 client.4148.objecter ms_dispatch2 0x7f7cb8000b90 osd_map(8..8 src has 1..8) 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 3 client.4148.objecter handle_osd_map got epochs [8,8] > 0 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 3 client.4148.objecter handle_osd_map decoding full epoch 8 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cb4ff9640 20 client.4148.objecter dump_active .. 0 homeless 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.838+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb80910e0 con 0x7f7cb8090280 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.839+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f7ca40033e0 con 0x7f7cb8090280 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.839+0000 7f7cb4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:45.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.839+0000 7f7cb4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:45.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.867+0000 7f7cbe533640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:45.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.867+0000 7f7cbe533640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:45.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.867+0000 7f7cbe533640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:45.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.867+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cb8054eb0 con 0x7f7cb8090280 2026-02-21T01:27:45.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cb4ff9640 1 -- 10.20.193.43:0/2116482477 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 2995994702) 0x7f7ca4005d90 con 0x7f7cb8090280 2026-02-21T01:27:45.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cb4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:45.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cb4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:45.870 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:45.871 INFO:teuthology.orchestra.run.trial043.stdout:{"epoch":8,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","created":"2026-02-21T01:27:44.582175+0000","modified":"2026-02-21T01:27:45.744393+0000","last_up_change":"0.000000","last_in_change":"2026-02-21T01:27:45.744393+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e67289af-bac2-443d-83b5-4766298e9303","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4207f5e8-3ce8-4f55-bb23-a8605d56d872","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da0c4995-e8bf-480e-876d-be10b4196751","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2cb6a730-2373-4354-904c-57509d260325","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22624587-71c2-4992-b8bb-6ff8f9fad066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b7f8c29f-504c-4cfe-b959-03fe02b39f69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-21T01:27:45.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 10 librados: watch_flush enter 2026-02-21T01:27:45.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 10 librados: watch_flush exit 2026-02-21T01:27:45.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 20 client.4148.objecter shutdown clearing up homeless session... 2026-02-21T01:27:45.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 10 client.4148.objecter successfully canceled tick 2026-02-21T01:27:45.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 10 monclient: shutdown 2026-02-21T01:27:45.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:45.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 >> v1:10.20.193.43:6790/0 conn(0x7f7cb8090280 legacy=0x7f7cb813dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:45.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 shutdown_connections 2026-02-21T01:27:45.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 >> 10.20.193.43:0/2116482477 conn(0x7f7cb8091c20 msgr2=0x7f7cb80574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:45.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 shutdown_connections 2026-02-21T01:27:45.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 1 -- 10.20.193.43:0/2116482477 wait complete. 2026-02-21T01:27:45.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:45.868+0000 7f7cbe533640 1 librados: shutdown 2026-02-21T01:27:45.875 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-21T01:27:45.876 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-21T01:27:45.987 INFO:tasks.ceph.osd.0.trial043.stderr:2026-02-21T01:27:45.986+0000 7fb72ea14900 -1 Falling back to public interface 2026-02-21T01:27:45.993 INFO:tasks.ceph.osd.2.trial043.stderr:2026-02-21T01:27:45.992+0000 7f836ad64900 -1 Falling back to public interface 2026-02-21T01:27:46.000 INFO:tasks.ceph.osd.1.trial043.stderr:2026-02-21T01:27:45.999+0000 7f0e7ae0c900 -1 Falling back to public interface 2026-02-21T01:27:46.049 INFO:tasks.ceph.osd.4.trial046.stderr:2026-02-21T01:27:46.046+0000 7fb4f5ef1900 -1 Falling back to public interface 2026-02-21T01:27:46.049 INFO:tasks.ceph.osd.5.trial046.stderr:2026-02-21T01:27:46.046+0000 7fed5b214900 -1 Falling back to public interface 2026-02-21T01:27:46.050 INFO:tasks.ceph.osd.4.trial046.stderr:2026-02-21T01:27:46.046+0000 7fb4f4e96640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2026-02-21T01:27:46.050 INFO:tasks.ceph.osd.5.trial046.stderr:2026-02-21T01:27:46.046+0000 7fed599a9640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2026-02-21T01:27:46.055 INFO:tasks.ceph.osd.3.trial046.stderr:2026-02-21T01:27:46.053+0000 7fd2cfaa8900 -1 Falling back to public interface 2026-02-21T01:27:46.481 DEBUG:teuthology.orchestra.run.trial043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-21T01:27:46.485 INFO:tasks.ceph.osd.0.trial043.stderr:2026-02-21T01:27:46.482+0000 7fb72ea14900 -1 osd.0 0 log_to_monitors true 2026-02-21T01:27:46.499 INFO:tasks.ceph.osd.1.trial043.stderr:2026-02-21T01:27:46.498+0000 7f0e7ae0c900 -1 osd.1 0 log_to_monitors true 2026-02-21T01:27:46.499 INFO:tasks.ceph.osd.2.trial043.stderr:2026-02-21T01:27:46.498+0000 7f836ad64900 -1 osd.2 0 log_to_monitors true 2026-02-21T01:27:46.550 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.541+0000 7fd1e0b99640 10 monclient: get_monmap_and_config 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.541+0000 7fd1e0b99640 10 monclient: build_initial_monmap 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.541+0000 7fd1e0b99640 10 monclient: monmap: 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:epoch 0 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:46.541673+0000 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:46.541673+0000 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:46.551 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.541+0000 7fd1e0b99640 1 Processor -- start 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.541+0000 7fd1e0b99640 1 -- start start 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.541+0000 7fd1e0b99640 10 monclient: init 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient(hunting): picked mon.noname-c con 0x7fd1dc058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient(hunting): picked mon.noname-b con 0x7fd1dc057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:46.552 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient(hunting): picked mon.noname-a con 0x7fd1dc181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc056c50 con 0x7fd1dc181e80 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc08eda0 con 0x7fd1dc058260 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc08f5c0 con 0x7fd1dc057630 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient(hunting): authenticate will time out at 598.247120s 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9d74640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fd1dc057630 0x7fd1dc08e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:46726/0 (socket says 10.20.193.43:46726) 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9d74640 1 -- 10.20.193.43:0/40013902 learned_addr learned my addr 10.20.193.43:0/40013902 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699285366 0 0) 0x7fd1dc08f5c0 con 0x7fd1dc057630 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): _negotiate 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:46.553 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): my global_id is 4160 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1c8003610 con 0x7fd1dc057630 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657714452 0 0) 0x7fd1dc056c50 con 0x7fd1dc181e80 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): _negotiate 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient(hunting): my global_id is 4176 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1dc08f5c0 con 0x7fd1dc181e80 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4090488891 0 0) 0x7fd1c8003610 con 0x7fd1dc057630 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 >> v1:10.20.193.46:6789/0 conn(0x7fd1dc058260 legacy=0x7fd1dc08df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 >> v1:10.20.193.43:6789/0 conn(0x7fd1dc181e80 legacy=0x7fd1dc1a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:46.554 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: _finish_hunting 0 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 monclient: found mon.noname-b 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc0563b0 con 0x7fd1dc057630 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: _finish_auth 0 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: _check_auth_tickets 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd1c4002df0 con 0x7fd1dc057630 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 5 monclient: authenticate success, global_id 4160 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: dump: 2026-02-21T01:27:46.555 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1c4003040 con 0x7fd1dc057630 2026-02-21T01:27:46.556 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 1 -- 10.20.193.43:0/40013902 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd1c4003480 con 0x7fd1dc057630 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 4 set_mon_vals no callback set 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1d9573640 10 monclient: dump: 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:46.557 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 10 monclient: shutdown 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 1 -- 10.20.193.43:0/40013902 >> v1:10.20.193.43:6790/0 conn(0x7fd1dc057630 legacy=0x7fd1dc08e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 1 -- 10.20.193.43:0/40013902 shutdown_connections 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.542+0000 7fd1e0b99640 1 -- 10.20.193.43:0/40013902 >> 10.20.193.43:0/40013902 conn(0x7fd1dc090360 msgr2=0x7fd1dc090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 -- 10.20.193.43:0/40013902 shutdown_connections 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 -- 10.20.193.43:0/40013902 wait complete. 2026-02-21T01:27:46.558 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient: build_initial_monmap 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient: monmap: 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:epoch 0 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:created 0.000000 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:46.559 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 librados: starting msgr at 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 librados: starting objecter 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 Processor -- start 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 -- start start 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 librados: setting wanted keys 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 librados: calling monclient init 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient: init 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient(hunting): picked mon.noname-c con 0x7fd1dc057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient(hunting): picked mon.noname-a con 0x7fd1dc058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient(hunting): picked mon.noname-b con 0x7fd1dc181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:46.560 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc1496b0 con 0x7fd1dc058260 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc130900 con 0x7fd1dc181e80 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc12df60 con 0x7fd1dc057630 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1e0b99640 10 monclient(hunting): authenticate will time out at 598.248840s 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1da575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fd1dc057630 0x7fd1dc148fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:46742/0 (socket says 10.20.193.43:46742) 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1da575640 1 -- 10.20.193.43:0/2645090263 learned_addr learned my addr 10.20.193.43:0/2645090263 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 client.?.objecter ms_handle_connect 0x7fd1dc057630 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 client.?.objecter ms_handle_connect 0x7fd1dc058260 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541929347 0 0) 0x7fd1dc1496b0 con 0x7fd1dc058260 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:46.561 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.543+0000 7fd1c2ffd640 10 monclient(hunting): my global_id is 4179 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1a8003610 con 0x7fd1dc058260 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255633152 0 0) 0x7fd1dc12df60 con 0x7fd1dc057630 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): my global_id is 4163 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1dc1496b0 con 0x7fd1dc057630 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1516071827 0 0) 0x7fd1a8003610 con 0x7fd1dc058260 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1dc12df60 con 0x7fd1dc058260 2026-02-21T01:27:46.562 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd1c40031f0 con 0x7fd1dc058260 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): dump: 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:46.563 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1432114257 0 0) 0x7fd1dc1496b0 con 0x7fd1dc057630 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1a8003610 con 0x7fd1dc057630 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd1d00030c0 con 0x7fd1dc057630 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient(hunting): dump: 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.564 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3780194550 0 0) 0x7fd1dc12df60 con 0x7fd1dc058260 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 >> v1:10.20.193.43:6790/0 conn(0x7fd1dc057630 legacy=0x7fd1dc148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 >> v1:10.20.193.46:6789/0 conn(0x7fd1dc181e80 legacy=0x7fd1dc171a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 monclient: found mon.a 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:46.565 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc12fa90 con 0x7fd1dc058260 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 5 monclient: authenticate success, global_id 4179 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 monclient: _renew_subs 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1dc12e5a0 con 0x7fd1dc058260 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1c4003390 con 0x7fd1dc058260 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd1c4004e80 con 0x7fd1dc058260 2026-02-21T01:27:46.566 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 monclient: dump: 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:46.567 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1d8d72640 4 set_mon_vals no callback set 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 client.4179.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 monclient: _renew_subs 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1dc12f2e0 con 0x7fd1dc058260 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 1 librados: init done 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fd1c4005430 con 0x7fd1dc058260 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 1907901852 0 0) 0x7fd1c4002ff0 con 0x7fd1dc058260 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 10 client.4179.objecter ms_dispatch2 0x7fd1dc000b90 osd_map(8..8 src has 1..8) 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 3 client.4179.objecter handle_osd_map got epochs [8,8] > 0 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 3 client.4179.objecter handle_osd_map decoding full epoch 8 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1c2ffd640 20 client.4179.objecter dump_active .. 0 homeless 2026-02-21T01:27:46.568 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:46.569 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:46.569 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:46.569 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.544+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1dc0008d0 con 0x7fd1dc058260 2026-02-21T01:27:46.569 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.545+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fd1c4006650 con 0x7fd1dc058260 2026-02-21T01:27:46.569 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.545+0000 7fd1c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:46.569 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.545+0000 7fd1c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:46.577 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:46.577 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:46.578 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:46.578 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1dc092830 con 0x7fd1dc058260 2026-02-21T01:27:46.578 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1c2ffd640 1 -- 10.20.193.43:0/2645090263 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 2995994702) 0x7fd1c40068d0 con 0x7fd1dc058260 2026-02-21T01:27:46.578 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:46.578 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:46.578 INFO:teuthology.misc.health.trial043.stdout: 2026-02-21T01:27:46.578 INFO:teuthology.misc.health.trial043.stdout:{"epoch":8,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","created":"2026-02-21T01:27:44.582175+0000","modified":"2026-02-21T01:27:45.744393+0000","last_up_change":"0.000000","last_in_change":"2026-02-21T01:27:45.744393+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e67289af-bac2-443d-83b5-4766298e9303","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4207f5e8-3ce8-4f55-bb23-a8605d56d872","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da0c4995-e8bf-480e-876d-be10b4196751","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2cb6a730-2373-4354-904c-57509d260325","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22624587-71c2-4992-b8bb-6ff8f9fad066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b7f8c29f-504c-4cfe-b959-03fe02b39f69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 10 librados: watch_flush enter 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 10 librados: watch_flush exit 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 20 client.4179.objecter shutdown clearing up homeless session... 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 10 client.4179.objecter successfully canceled tick 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 10 monclient: shutdown 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.576+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 >> v1:10.20.193.43:6789/0 conn(0x7fd1dc058260 legacy=0x7fd1dc170350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.577+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 shutdown_connections 2026-02-21T01:27:46.580 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.577+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 >> 10.20.193.43:0/2645090263 conn(0x7fd1dc090360 msgr2=0x7fd1dc08aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:46.581 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.577+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 shutdown_connections 2026-02-21T01:27:46.581 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.577+0000 7fd1e0b99640 1 -- 10.20.193.43:0/2645090263 wait complete. 2026-02-21T01:27:46.581 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:46.577+0000 7fd1e0b99640 1 librados: shutdown 2026-02-21T01:27:46.583 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-21T01:27:46.607 INFO:tasks.ceph.osd.5.trial046.stderr:2026-02-21T01:27:46.605+0000 7fed5b214900 -1 osd.5 0 log_to_monitors true 2026-02-21T01:27:46.620 INFO:tasks.ceph.osd.4.trial046.stderr:2026-02-21T01:27:46.617+0000 7fb4f5ef1900 -1 osd.4 0 log_to_monitors true 2026-02-21T01:27:46.651 INFO:tasks.ceph.osd.3.trial046.stderr:2026-02-21T01:27:46.649+0000 7fd2cfaa8900 -1 osd.3 0 log_to_monitors true 2026-02-21T01:27:47.618 INFO:tasks.ceph.mgr.x.trial046.stderr:2026-02-21T01:27:47.615+0000 7f07f2e67640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-21T01:27:47.618 INFO:tasks.ceph.mgr.x.trial046.stderr:2026-02-21T01:27:47.616+0000 7f07f2e67640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-21T01:27:47.749 INFO:tasks.ceph.osd.0.trial043.stderr:2026-02-21T01:27:47.748+0000 7fb72996f640 -1 osd.0 0 waiting for initial osdmap 2026-02-21T01:27:47.750 INFO:tasks.ceph.osd.1.trial043.stderr:2026-02-21T01:27:47.748+0000 7f0e75d40640 -1 osd.1 0 waiting for initial osdmap 2026-02-21T01:27:47.750 INFO:tasks.ceph.osd.2.trial043.stderr:2026-02-21T01:27:47.748+0000 7f83664cf640 -1 osd.2 0 waiting for initial osdmap 2026-02-21T01:27:47.751 INFO:tasks.ceph.osd.3.trial046.stderr:2026-02-21T01:27:47.747+0000 7fd2cb213640 -1 osd.3 0 waiting for initial osdmap 2026-02-21T01:27:47.751 INFO:tasks.ceph.osd.5.trial046.stderr:2026-02-21T01:27:47.747+0000 7fed5616f640 -1 osd.5 0 waiting for initial osdmap 2026-02-21T01:27:47.751 INFO:tasks.ceph.osd.4.trial046.stderr:2026-02-21T01:27:47.747+0000 7fb4f165c640 -1 osd.4 0 waiting for initial osdmap 2026-02-21T01:27:47.752 INFO:tasks.ceph.osd.3.trial046.stderr:2026-02-21T01:27:47.749+0000 7fd2c702b640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-21T01:27:47.752 INFO:tasks.ceph.osd.5.trial046.stderr:2026-02-21T01:27:47.749+0000 7fed4df7f640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-21T01:27:47.752 INFO:tasks.ceph.osd.4.trial046.stderr:2026-02-21T01:27:47.749+0000 7fb4ed474640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-21T01:27:47.753 INFO:tasks.ceph.osd.1.trial043.stderr:2026-02-21T01:27:47.750+0000 7f0e6db50640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-21T01:27:47.754 INFO:tasks.ceph.osd.0.trial043.stderr:2026-02-21T01:27:47.750+0000 7fb725787640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-21T01:27:47.754 INFO:tasks.ceph.osd.2.trial043.stderr:2026-02-21T01:27:47.750+0000 7f835e2df640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-21T01:27:53.188 DEBUG:teuthology.orchestra.run.trial043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient: get_monmap_and_config 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient: build_initial_monmap 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient: monmap: 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:epoch 0 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:53.250527+0000 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:53.250527+0000 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.251 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:53.252 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:53.252 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:53.252 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 1 Processor -- start 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 1 -- start start 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient: init 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient(hunting): picked mon.noname-a con 0x7f498005cef0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient(hunting): picked mon.noname-b con 0x7f498008a730 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient(hunting): picked mon.noname-c con 0x7f498013fa20 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498005d9d0 con 0x7f498005cef0 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498008b590 con 0x7f498013fa20 2026-02-21T01:27:53.255 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498005b9c0 con 0x7f498008a730 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.249+0000 7f4986455640 10 monclient(hunting): authenticate will time out at 604.955972s 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497ffff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f498005cef0 0x7f498005d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36060/0 (socket says 10.20.193.43:36060) 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497ffff640 1 -- 10.20.193.43:0/540072965 learned_addr learned my addr 10.20.193.43:0/540072965 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1169945997 0 0) 0x7f498005b9c0 con 0x7f498008a730 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): my global_id is 4190 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4964003610 con 0x7f498008a730 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3407118820 0 0) 0x7f498005d9d0 con 0x7f498005cef0 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.256 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient(hunting): my global_id is 4206 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f498005b9c0 con 0x7f498005cef0 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3517519732 0 0) 0x7f4964003610 con 0x7f498008a730 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 >> v1:10.20.193.46:6789/0 conn(0x7f498013fa20 legacy=0x7f49801a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 >> v1:10.20.193.43:6789/0 conn(0x7f498005cef0 legacy=0x7f498005d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 monclient: found mon.noname-b 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498013f210 con 0x7f498008a730 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: _finish_auth 0 2026-02-21T01:27:53.257 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4970002df0 con 0x7f498008a730 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: dump: 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.258 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.259 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.259 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:53.259 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 5 monclient: authenticate success, global_id 4190 2026-02-21T01:27:53.259 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:53.259 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49700030f0 con 0x7f498008a730 2026-02-21T01:27:53.259 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:53.259 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 1 -- 10.20.193.43:0/540072965 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4970003530 con 0x7f498008a730 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f497effd640 10 monclient: dump: 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.260 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 4 set_mon_vals no callback set 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 10 monclient: shutdown 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 1 -- 10.20.193.43:0/540072965 >> v1:10.20.193.43:6790/0 conn(0x7f498008a730 legacy=0x7f4980180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 1 -- 10.20.193.43:0/540072965 shutdown_connections 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 1 -- 10.20.193.43:0/540072965 >> 10.20.193.43:0/540072965 conn(0x7f498008f480 msgr2=0x7f498008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:53.261 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 1 -- 10.20.193.43:0/540072965 shutdown_connections 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.250+0000 7f4986455640 1 -- 10.20.193.43:0/540072965 wait complete. 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient: build_initial_monmap 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient: monmap: 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:epoch 0 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:created 0.000000 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:53.262 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 librados: starting msgr at 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 librados: starting objecter 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 Processor -- start 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 -- start start 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 librados: setting wanted keys 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 librados: calling monclient init 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient: init 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient(hunting): picked mon.noname-c con 0x7f498005cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:53.263 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient(hunting): picked mon.noname-b con 0x7f498008a730 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient(hunting): picked mon.noname-a con 0x7f498013fa20 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4980108530 con 0x7f498013fa20 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49801072f0 con 0x7f498008a730 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4980108db0 con 0x7f498005cef0 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f4986455640 10 monclient(hunting): authenticate will time out at 604.957655s 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497ffff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f498005cef0 0x7f498013b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53134/0 (socket says 10.20.193.43:53134) 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497ffff640 1 -- 10.20.193.43:0/4138639093 learned_addr learned my addr 10.20.193.43:0/4138639093 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 client.?.objecter ms_handle_connect 0x7f498005cef0 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 client.?.objecter ms_handle_connect 0x7f498013fa20 2026-02-21T01:27:53.264 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395036301 0 0) 0x7f4980108db0 con 0x7f498005cef0 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): my global_id is 4193 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4950003610 con 0x7f498005cef0 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081378810 0 0) 0x7f4980108530 con 0x7f498013fa20 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.265 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): my global_id is 4209 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4980108db0 con 0x7f498013fa20 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 client.?.objecter ms_handle_connect 0x7f498008a730 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2781982811 0 0) 0x7f4980108db0 con 0x7f498013fa20 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4980108530 con 0x7f498013fa20 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4974003390 con 0x7f498013fa20 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:53.266 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): dump: 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:53.267 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1753195563 0 0) 0x7f4950003610 con 0x7f498005cef0 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4980108db0 con 0x7f498005cef0 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f496c002f10 con 0x7f498005cef0 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.251+0000 7f497cff9640 10 monclient(hunting): dump: 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.268 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1245568035 0 0) 0x7f4980108530 con 0x7f498013fa20 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 >> v1:10.20.193.43:6790/0 conn(0x7f498005cef0 legacy=0x7f498013b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 >> v1:10.20.193.46:6789/0 conn(0x7f498008a730 legacy=0x7f49801a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 monclient: found mon.a 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4980109650 con 0x7f498013fa20 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:53.269 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:53.270 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 5 monclient: authenticate success, global_id 4209 2026-02-21T01:27:53.270 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 monclient: _renew_subs 2026-02-21T01:27:53.270 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.270 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4980107e50 con 0x7f498013fa20 2026-02-21T01:27:53.270 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 client.4209.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:53.270 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 monclient: _renew_subs 2026-02-21T01:27:53.270 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f498013bf40 con 0x7f498013fa20 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 1 librados: init done 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49740037c0 con 0x7f498013fa20 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4974003ed0 con 0x7f498013fa20 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497e7fc640 4 set_mon_vals no callback set 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 monclient: dump: 2026-02-21T01:27:53.271 INFO:teuthology.misc.health.trial043.stderr:epoch 1 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr: 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:53.272 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f498005e190 con 0x7f498013fa20 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 4) ==== 51095+0+0 (unknown 4294191691 0 0) 0x7f49740040f0 con 0x7f498013fa20 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3147+0+0 (unknown 3020609874 0 0) 0x7f497404cd60 con 0x7f498013fa20 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 10 client.4209.objecter ms_dispatch2 0x7f4980000b90 osd_map(15..15 src has 1..15) 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 3 client.4209.objecter handle_osd_map got epochs [15,15] > 0 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 3 client.4209.objecter handle_osd_map decoding full epoch 15 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.252+0000 7f497cff9640 20 client.4209.objecter dump_active .. 0 homeless 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.253+0000 7f497ffff640 10 monclient: get_auth_request con 0x7f495003e8e0 auth_method 0 2026-02-21T01:27:53.273 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.253+0000 7f497cff9640 10 client.4209.objecter ms_handle_connect 0x7f495003e8e0 2026-02-21T01:27:53.274 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.255+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f498005e190 con 0x7f498013fa20 2026-02-21T01:27:53.274 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.255+0000 7f497cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:53.274 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.255+0000 7f497cff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.360+0000 7f4986455640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.360+0000 7f4986455640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.360+0000 7f4986455640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.360+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4980054ff0 con 0x7f498013fa20 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.360+0000 7f497cff9640 1 -- 10.20.193.43:0/4138639093 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9056 (unknown 4221056075 0 3326669920) 0x7f4974016930 con 0x7f498013fa20 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.360+0000 7f497cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.360+0000 7f497cff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stdout: 2026-02-21T01:27:53.363 INFO:teuthology.misc.health.trial043.stdout:{"epoch":15,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","created":"2026-02-21T01:27:44.582175+0000","modified":"2026-02-21T01:27:52.766425+0000","last_up_change":"2026-02-21T01:27:48.746376+0000","last_in_change":"2026-02-21T01:27:45.744393+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-21T01:27:50.628015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e67289af-bac2-443d-83b5-4766298e9303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6800","nonce":1072173340}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6801","nonce":1072173340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6803","nonce":1072173340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6802","nonce":1072173340}]},"public_addr":"10.20.193.43:6800/1072173340","cluster_addr":"10.20.193.43:6801/1072173340","heartbeat_back_addr":"10.20.193.43:6803/1072173340","heartbeat_front_addr":"10.20.193.43:6802/1072173340","state":["exists","up"]},{"osd":1,"uuid":"4207f5e8-3ce8-4f55-bb23-a8605d56d872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6808","nonce":3522371706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6809","nonce":3522371706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6811","nonce":3522371706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6810","nonce":3522371706}]},"public_addr":"10.20.193.43:6808/3522371706","cluster_addr":"10.20.193.43:6809/3522371706","heartbeat_back_addr":"10.20.193.43:6811/3522371706","heartbeat_front_addr":"10.20.193.43:6810/3522371706","state":["exists","up"]},{"osd":2,"uuid":"da0c4995-e8bf-480e-876d-be10b4196751","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6804","nonce":3123352217}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6805","nonce":3123352217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6807","nonce":3123352217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6806","nonce":3123352217}]},"public_addr":"10.20.193.43:6804/3123352217","cluster_addr":"10.20.193.43:6805/3123352217","heartbeat_back_addr":"10.20.193.43:6807/3123352217","heartbeat_front_addr":"10.20.193.43:6806/3123352217","state":["exists","up"]},{"osd":3,"uuid":"2cb6a730-2373-4354-904c-57509d260325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6808","nonce":3250452844}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6809","nonce":3250452844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6811","nonce":3250452844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6810","nonce":3250452844}]},"public_addr":"10.20.193.46:6808/3250452844","cluster_addr":"10.20.193.46:6809/3250452844","heartbeat_back_addr":"10.20.193.46:6811/3250452844","heartbeat_front_addr":"10.20.193.46:6810/3250452844","state":["exists","up"]},{"osd":4,"uuid":"22624587-71c2-4992-b8bb-6ff8f9fad066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6802","nonce":3807500891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6804","nonce":3807500891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6807","nonce":3807500891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6806","nonce":3807500891}]},"public_addr":"10.20.193.46:6802/3807500891","cluster_addr":"10.20.193.46:6804/3807500891","heartbeat_back_addr":"10.20.193.46:6807/3807500891","heartbeat_front_addr":"10.20.193.46:6806/3807500891","state":["exists","up"]},{"osd":5,"uuid":"b7f8c29f-504c-4cfe-b959-03fe02b39f69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6800","nonce":1266691672}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6801","nonce":1266691672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6805","nonce":1266691672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6803","nonce":1266691672}]},"public_addr":"10.20.193.46:6800/1266691672","cluster_addr":"10.20.193.46:6801/1266691672","heartbeat_back_addr":"10.20.193.46:6805/1266691672","heartbeat_front_addr":"10.20.193.46:6803/1266691672","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.465320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.517324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.541306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.629304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.660956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.636067+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 10 librados: watch_flush enter 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 10 librados: watch_flush exit 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 20 client.4209.objecter shutdown clearing up homeless session... 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 10 client.4209.objecter successfully canceled tick 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 >> v1:10.20.193.46:6812/860801619 conn(0x7f495003e8e0 legacy=0x7f495005ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 10 monclient: shutdown 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 >> v1:10.20.193.43:6789/0 conn(0x7f498013fa20 legacy=0x7f49801a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 shutdown_connections 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 >> 10.20.193.43:0/4138639093 conn(0x7f498008f480 msgr2=0x7f498008bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 shutdown_connections 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 1 -- 10.20.193.43:0/4138639093 wait complete. 2026-02-21T01:27:53.364 INFO:teuthology.misc.health.trial043.stderr:2026-02-21T01:27:53.361+0000 7f4986455640 1 librados: shutdown 2026-02-21T01:27:53.370 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-21T01:27:53.370 INFO:tasks.ceph:Creating RBD pool 2026-02-21T01:27:53.370 DEBUG:teuthology.orchestra.run.trial043:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-21T01:27:53.434 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.432+0000 7ff1ab945640 10 monclient: get_monmap_and_config 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.432+0000 7ff1ab945640 10 monclient: build_initial_monmap 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.432+0000 7ff1ab945640 10 monclient: monmap: 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:53.433846+0000 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:53.433846+0000 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:53.435 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.432+0000 7ff1ab945640 1 Processor -- start 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.432+0000 7ff1ab945640 1 -- start start 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.432+0000 7ff1ab945640 10 monclient: init 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient(hunting): picked mon.noname-b con 0x7ff1a4058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient(hunting): picked mon.noname-c con 0x7ff1a4057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:53.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient(hunting): picked mon.noname-a con 0x7ff1a4181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a4056c50 con 0x7ff1a4181e80 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a408eda0 con 0x7ff1a4057630 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a408f5c0 con 0x7ff1a4058260 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient(hunting): authenticate will time out at 605.139308s 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1a9ebb640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff1a4181e80 0x7ff1a41a2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36080/0 (socket says 10.20.193.43:36080) 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1a9ebb640 1 -- 10.20.193.43:0/3440991068 learned_addr learned my addr 10.20.193.43:0/3440991068 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459115073 0 0) 0x7ff1a4056c50 con 0x7ff1a4181e80 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): my global_id is 4212 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff18c003610 con 0x7ff1a4181e80 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630454113 0 0) 0x7ff1a408f5c0 con 0x7ff1a4058260 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient(hunting): my global_id is 4196 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1a4056c50 con 0x7ff1a4058260 2026-02-21T01:27:53.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3706361200 0 0) 0x7ff18c003610 con 0x7ff1a4181e80 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 >> v1:10.20.193.43:6790/0 conn(0x7ff1a4058260 legacy=0x7ff1a408df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 >> v1:10.20.193.46:6789/0 conn(0x7ff1a4057630 legacy=0x7ff1a408e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 monclient: found mon.noname-a 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a40563b0 con 0x7ff1a4181e80 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: _finish_auth 0 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff1a0003170 con 0x7ff1a4181e80 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 5 monclient: authenticate success, global_id 4212 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: dump: 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.441 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1a0003340 con 0x7ff1a4181e80 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 1 -- 10.20.193.43:0/3440991068 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff1a0003780 con 0x7ff1a4181e80 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff1ab945640 4 set_mon_vals no callback set 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.433+0000 7ff193fff640 10 monclient: dump: 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 10 monclient: shutdown 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 -- 10.20.193.43:0/3440991068 >> v1:10.20.193.43:6789/0 conn(0x7ff1a4181e80 legacy=0x7ff1a41a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 -- 10.20.193.43:0/3440991068 shutdown_connections 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 -- 10.20.193.43:0/3440991068 >> 10.20.193.43:0/3440991068 conn(0x7ff1a4090360 msgr2=0x7ff1a4090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:53.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 -- 10.20.193.43:0/3440991068 shutdown_connections 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 -- 10.20.193.43:0/3440991068 wait complete. 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 10 monclient: build_initial_monmap 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 10 monclient: monmap: 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 librados: starting msgr at 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 librados: starting objecter 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 Processor -- start 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 -- start start 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 librados: setting wanted keys 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 1 librados: calling monclient init 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.434+0000 7ff1ab945640 10 monclient: init 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient(hunting): picked mon.noname-c con 0x7ff1a4057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient(hunting): picked mon.noname-a con 0x7ff1a4058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:53.443 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient(hunting): picked mon.noname-b con 0x7ff1a4181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a41497b0 con 0x7ff1a4058260 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a4130a00 con 0x7ff1a4181e80 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a412fb90 con 0x7ff1a4057630 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient(hunting): authenticate will time out at 605.141170s 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1a96ba640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff1a4057630 0x7ff1a41490a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53150/0 (socket says 10.20.193.43:53150) 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1a96ba640 1 -- 10.20.193.43:0/681040589 learned_addr learned my addr 10.20.193.43:0/681040589 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1a8eb9640 1 --1- 10.20.193.43:0/681040589 >> v1:10.20.193.43:6789/0 conn(0x7ff1a4058260 0x7ff1a4170450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36088/0 (socket says 10.20.193.43:36088) 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 client.?.objecter ms_handle_connect 0x7ff1a4058260 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 client.?.objecter ms_handle_connect 0x7ff1a4057630 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 110375183 0 0) 0x7ff1a41497b0 con 0x7ff1a4058260 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): my global_id is 4215 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff174003610 con 0x7ff1a4058260 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47910972 0 0) 0x7ff1a412fb90 con 0x7ff1a4057630 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): my global_id is 4199 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1a41497b0 con 0x7ff1a4057630 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 263403303 0 0) 0x7ff174003610 con 0x7ff1a4058260 2026-02-21T01:27:53.444 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1a412fb90 con 0x7ff1a4058260 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff198003fe0 con 0x7ff1a4058260 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): dump: 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1719943581 0 0) 0x7ff1a41497b0 con 0x7ff1a4057630 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff174003610 con 0x7ff1a4057630 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff1940030a0 con 0x7ff1a4057630 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient(hunting): dump: 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.445 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 client.?.objecter ms_handle_connect 0x7ff1a4181e80 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 441325572 0 0) 0x7ff1a412fb90 con 0x7ff1a4058260 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 >> v1:10.20.193.43:6790/0 conn(0x7ff1a4057630 legacy=0x7ff1a41490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 >> v1:10.20.193.46:6789/0 conn(0x7ff1a4181e80 legacy=0x7ff1a4171b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 monclient: found mon.a 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a412e6a0 con 0x7ff1a4058260 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 5 monclient: authenticate success, global_id 4215 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _renew_subs 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a4130160 con 0x7ff1a4058260 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 client.4215.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _renew_subs 2026-02-21T01:27:53.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1a412f3e0 con 0x7ff1a4058260 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 1 librados: init done 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1980026d0 con 0x7ff1a4058260 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff198002900 con 0x7ff1a4058260 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1937fe640 4 set_mon_vals no callback set 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff191ffb640 10 monclient: dump: 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.435+0000 7ff1ab945640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a40008d0 con 0x7ff1a4058260 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 4) ==== 51095+0+0 (unknown 4294191691 0 0) 0x7ff198002aa0 con 0x7ff1a4058260 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3147+0+0 (unknown 3020609874 0 0) 0x7ff19804da90 con 0x7ff1a4058260 2026-02-21T01:27:53.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff191ffb640 10 client.4215.objecter ms_dispatch2 0x7ff1a4000b90 osd_map(15..15 src has 1..15) 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff191ffb640 3 client.4215.objecter handle_osd_map got epochs [15,15] > 0 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff191ffb640 3 client.4215.objecter handle_osd_map decoding full epoch 15 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff191ffb640 20 client.4215.objecter dump_active .. 0 homeless 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff1a96ba640 10 monclient: get_auth_request con 0x7ff17403e8d0 auth_method 0 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.436+0000 7ff191ffb640 10 client.4215.objecter ms_handle_connect 0x7ff17403e8d0 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.438+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff1980176c0 con 0x7ff1a4058260 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.438+0000 7ff191ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:53.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.438+0000 7ff191ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:53.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.545+0000 7ff1ab945640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-21T01:27:53.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.545+0000 7ff1ab945640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-21T01:27:53.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.545+0000 7ff1ab945640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.545+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7ff1a412e0e0 con 0x7ff1a4058260 2026-02-21T01:27:53.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.600+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff19804b8a0 con 0x7ff1a4058260 2026-02-21T01:27:53.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.798+0000 7ff191ffb640 1 -- 10.20.193.43:0/681040589 <== mon.0 v1:10.20.193.43:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (unknown 231814880 0 0) 0x7ff198002dc0 con 0x7ff1a4058260 2026-02-21T01:27:53.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.798+0000 7ff191ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-21T01:27:53.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.798+0000 7ff191ffb640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-21T01:27:53.802 INFO:teuthology.orchestra.run.trial043.stderr:pool 'rbd' created 2026-02-21T01:27:53.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.801+0000 7ff1ab945640 10 librados: watch_flush enter 2026-02-21T01:27:53.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 10 librados: watch_flush exit 2026-02-21T01:27:53.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 20 client.4215.objecter shutdown clearing up homeless session... 2026-02-21T01:27:53.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 10 client.4215.objecter successfully canceled tick 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 >> v1:10.20.193.46:6812/860801619 conn(0x7ff17403e8d0 legacy=0x7ff17405ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 10 monclient: shutdown 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 >> v1:10.20.193.43:6789/0 conn(0x7ff1a4058260 legacy=0x7ff1a4170450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 shutdown_connections 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 >> 10.20.193.43:0/681040589 conn(0x7ff1a4090360 msgr2=0x7ff1a408aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 shutdown_connections 2026-02-21T01:27:53.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 1 -- 10.20.193.43:0/681040589 wait complete. 2026-02-21T01:27:53.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.802+0000 7ff1ab945640 1 librados: shutdown 2026-02-21T01:27:53.813 DEBUG:teuthology.orchestra.run.trial043:> rbd --cluster ceph pool init rbd 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.841+0000 7f7ada6c5300 10 monclient: get_monmap_and_config 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.841+0000 7f7ada6c5300 10 monclient: build_initial_monmap 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient: monmap: 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:53.843365+0000 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:53.843365+0000 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 1 Processor -- start 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 1 -- start start 2026-02-21T01:27:53.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient: init 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient: _reopen_session rank -1 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient(hunting): picked mon.noname-b con 0x55fb56dfedd0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient(hunting): picked mon.noname-a con 0x55fb56e032a0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient(hunting): picked mon.noname-c con 0x55fb56e036e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55fb56c3e0c0 con 0x55fb56e032a0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55fb56c4da80 con 0x55fb56e036e0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55fb56dff1a0 con 0x55fb56dfedd0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient(hunting): _renew_subs 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ada6c5300 10 monclient(hunting): authenticate will time out at 605.548833s 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ad8979640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x55fb56e032a0 0x55fb56ef5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36100/0 (socket says 10.20.193.43:36100) 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.842+0000 7f7ad8979640 1 -- 10.20.193.43:0/1991814427 learned_addr learned my addr 10.20.193.43:0/1991814427 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179197430 0 0) 0x55fb56dff1a0 con 0x55fb56dfedd0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): my global_id is 4202 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ac0001e10 con 0x55fb56dfedd0 2026-02-21T01:27:53.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012551796 0 0) 0x55fb56c3e0c0 con 0x55fb56e032a0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient(hunting): my global_id is 4218 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55fb56dff1a0 con 0x55fb56e032a0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2592404144 0 0) 0x55fb56dff1a0 con 0x55fb56e032a0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 >> v1:10.20.193.43:6790/0 conn(0x55fb56dfedd0 legacy=0x55fb56e02b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 >> v1:10.20.193.46:6789/0 conn(0x55fb56e036e0 legacy=0x55fb56f17190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 monclient: found mon.noname-a 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb56dff610 con 0x55fb56e032a0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: _finish_auth 0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ac40015f0 con 0x55fb56e032a0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: dump: 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 5 monclient: authenticate success, global_id 4218 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ac4001840 con 0x55fb56e032a0 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 1 -- 10.20.193.43:0/1991814427 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ac4001c80 con 0x55fb56e032a0 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7acbfff640 10 monclient: dump: 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 10 monclient: get_monmap_and_config success 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 4 set_mon_vals no callback set 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 10 monclient: shutdown 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 1 -- 10.20.193.43:0/1991814427 >> v1:10.20.193.43:6789/0 conn(0x55fb56e032a0 legacy=0x55fb56ef5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 1 -- 10.20.193.43:0/1991814427 shutdown_connections 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 1 -- 10.20.193.43:0/1991814427 >> 10.20.193.43:0/1991814427 conn(0x55fb56e05170 msgr2=0x55fb56e05570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 1 -- 10.20.193.43:0/1991814427 shutdown_connections 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.843+0000 7f7ada6c5300 1 -- 10.20.193.43:0/1991814427 wait complete. 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient: build_initial_monmap 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient: monmap: 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 librados: starting msgr at 2026-02-21T01:27:53.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 librados: starting objecter 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 Processor -- start 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 -- start start 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 librados: setting wanted keys 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 librados: calling monclient init 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient: init 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient: _reopen_session rank -1 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient(hunting): picked mon.noname-c con 0x55fb56dfedd0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient(hunting): picked mon.noname-a con 0x55fb56e032a0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient(hunting): picked mon.noname-b con 0x55fb56e036e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55fb56ea3e80 con 0x55fb56e032a0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55fb56ea2990 con 0x55fb56e036e0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55fb56ea4cf0 con 0x55fb56dfedd0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient(hunting): _renew_subs 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ada6c5300 10 monclient(hunting): authenticate will time out at 605.550629s 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ad917a640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x55fb56dfedd0 0x55fb56ebd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53164/0 (socket says 10.20.193.43:53164) 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ad917a640 1 -- 10.20.193.43:0/3338031291 learned_addr learned my addr 10.20.193.43:0/3338031291 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 client.?.objecter ms_handle_connect 0x55fb56dfedd0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 client.?.objecter ms_handle_connect 0x55fb56e032a0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670870847 0 0) 0x55fb56ea4cf0 con 0x55fb56dfedd0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): my global_id is 4205 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ab8001e10 con 0x55fb56dfedd0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659003370 0 0) 0x55fb56ea3e80 con 0x55fb56e032a0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): my global_id is 4221 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55fb56ea4cf0 con 0x55fb56e032a0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2613734758 0 0) 0x7f7ab8001e10 con 0x55fb56dfedd0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55fb56ea3e80 con 0x55fb56dfedd0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ad00019c0 con 0x55fb56dfedd0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:53.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): dump: 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3894737702 0 0) 0x55fb56ea4cf0 con 0x55fb56e032a0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ab8001e10 con 0x55fb56e032a0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ac40019d0 con 0x55fb56e032a0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 10 monclient(hunting): dump: 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3287424394 0 0) 0x55fb56ea3e80 con 0x55fb56dfedd0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 >> v1:10.20.193.46:6789/0 conn(0x55fb56e036e0 legacy=0x55fb56f25e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.844+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 >> v1:10.20.193.43:6789/0 conn(0x55fb56e032a0 legacy=0x55fb56f04750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: _finish_hunting 0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 1 monclient: found mon.c 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb56ea4450 con 0x55fb56dfedd0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: _finish_auth 0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: _check_auth_tickets 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 5 monclient: authenticate success, global_id 4205 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 monclient: _renew_subs 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x55fb56ebd9a0 con 0x55fb56dfedd0 2026-02-21T01:27:53.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ad0001f20 con 0x55fb56dfedd0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ad00022b0 con 0x55fb56dfedd0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 monclient: dump: 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 monclient: _renew_subs 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x55fb56ea3730 con 0x55fb56dfedd0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 1 librados: init done 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7acb7fe640 4 set_mon_vals no callback set 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 librados: wait_for_osdmap waiting 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f7ad00024d0 con 0x55fb56dfedd0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(16..16 src has 1..16) ==== 3492+0+0 (unknown 3779855142 0 0) 0x7f7ad004c500 con 0x55fb56dfedd0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_map(16..16 src has 1..16) 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map got epochs [16,16] > 0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map decoding full epoch 16 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ac97fa640 20 client.4205.objecter dump_active .. 0 homeless 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 librados: wait_for_osdmap done waiting 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55fb56ec3ac0 con 0x55fb56dfedd0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.845+0000 7f7ad8979640 10 monclient: get_auth_request con 0x7f7ab803d180 auth_method 0 2026-02-21T01:27:53.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:53.846+0000 7f7ac97fa640 10 client.4205.objecter ms_handle_connect 0x7f7ab803d180 2026-02-21T01:27:54.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (unknown 1851909647 0 0) 0x7f7ad0015ef0 con 0x55fb56dfedd0 2026-02-21T01:27:54.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7ac97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-21T01:27:54.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7ac97fa640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-21T01:27:54.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7ada6c5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:54.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x55fb56cd6fb0 con 0x55fb56dfedd0 2026-02-21T01:27:54.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (unknown 391748328 0 0) 0x7f7ad0014f50 con 0x55fb56dfedd0 2026-02-21T01:27:54.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7ac97fa640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7acb7fe640 10 client.4205.objecter _get_latest_version latest 17, waiting 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7acb7fe640 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7acb7fe640 10 monclient: _renew_subs 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7acb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.801+0000 7f7acb7fe640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=17}) -- 0x7f7ab0002ae0 con 0x55fb56dfedd0 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 11 ==== osd_map(17..17 src has 1..17) ==== 661+0+0 (unknown 1528283240 0 0) 0x7f7ad004b460 con 0x55fb56dfedd0 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ac97fa640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_map(17..17 src has 1..17) 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map got epochs [17,17] > 16 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map decoding incremental epoch 17 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ac97fa640 20 client.4205.objecter dump_active .. 0 homeless 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 10 librados: create oid=rbd_trash nspace= 2026-02-21T01:27:54.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 10 client.4205.objecter _op_submit op 0x55fb56f275a0 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 20 client.4205.objecter _calc_target epoch 17 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 20 client.4205.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 10 client.4205.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [5,2] primary 5 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 20 client.4205.objecter _get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 10 client.4205.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.5 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 20 client.4205.objecter get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 15 client.4205.objecter _session_op_assign 5 1 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 15 client.4205.objecter _send_op 1 to 2.3 on osd.5 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.46:6800/1266691672 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x55fb56f49a60 con 0x55fb56f27f60 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada6c5300 5 client.4205.objecter 1 in flight 2026-02-21T01:27:54.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ada403640 10 monclient: get_auth_request con 0x55fb56f27f60 auth_method 0 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.802+0000 7f7ac97fa640 10 client.4205.objecter ms_handle_connect 0x55fb56f27f60 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 1 -- 10.20.193.43:0/3338031291 <== osd.5 v1:10.20.193.46:6800/1266691672 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 1703302865 0 0) 0x7f7acc002820 con 0x55fb56f27f60 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 10 client.4205.objecter in handle_osd_op_reply 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 7 client.4205.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 10 client.4205.objecter op 0 rval 0 len 0 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 15 client.4205.objecter handle_osd_op_reply completed tid 1 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 15 client.4205.objecter _finish_op 1 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 15 client.4205.objecter _session_op_remove 5 1 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada403640 5 client.4205.objecter 0 in flight 2026-02-21T01:27:54.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.803+0000 7f7ada6c5300 10 librados: Objecter returned from create r=0 2026-02-21T01:27:54.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 10 client.4205.objecter _op_submit op 0x55fb56f84630 2026-02-21T01:27:54.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 20 client.4205.objecter _calc_target epoch 17 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:27:54.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 20 client.4205.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-21T01:27:54.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 10 client.4205.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-21T01:27:54.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 20 client.4205.objecter _get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:54.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 10 client.4205.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.5 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 20 client.4205.objecter get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 15 client.4205.objecter _session_op_assign 5 2 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 15 client.4205.objecter _send_op 2 to 2.2 on osd.5 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.46:6800/1266691672 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55fb56f84b80 con 0x55fb56f27f60 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada6c5300 5 client.4205.objecter 1 in flight 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 1 -- 10.20.193.43:0/3338031291 <== osd.5 v1:10.20.193.46:6800/1266691672 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 4274215525 0 0) 0x7f7acc002820 con 0x55fb56f27f60 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 10 client.4205.objecter in handle_osd_op_reply 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 7 client.4205.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 10 client.4205.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:27:54.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 10 client.4205.objecter op 0 rval 0 len 0 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 15 client.4205.objecter handle_osd_op_reply completed tid 2 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 15 client.4205.objecter _finish_op 2 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 15 client.4205.objecter _session_op_remove 5 2 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.804+0000 7f7ada403640 5 client.4205.objecter 0 in flight 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 10 client.4205.objecter _op_submit op 0x55fb56f837c0 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 20 client.4205.objecter _calc_target epoch 17 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 20 client.4205.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 10 client.4205.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 20 client.4205.objecter _get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 10 client.4205.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.5 2026-02-21T01:27:54.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 20 client.4205.objecter get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 15 client.4205.objecter _session_op_assign 5 3 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 15 client.4205.objecter _send_op 3 to 2.2 on osd.5 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.46:6800/1266691672 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55fb56f83c70 con 0x55fb56f27f60 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada6c5300 5 client.4205.objecter 1 in flight 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 1 -- 10.20.193.43:0/3338031291 <== osd.5 v1:10.20.193.46:6800/1266691672 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 4287864937 0 0) 0x7f7acc002820 con 0x55fb56f27f60 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 10 client.4205.objecter in handle_osd_op_reply 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 7 client.4205.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 10 client.4205.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 10 client.4205.objecter op 0 rval 0 len 0 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 15 client.4205.objecter handle_osd_op_reply completed tid 3 2026-02-21T01:27:54.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 15 client.4205.objecter _finish_op 3 2026-02-21T01:27:54.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:54.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 15 client.4205.objecter _session_op_remove 5 3 2026-02-21T01:27:54.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7ada403640 5 client.4205.objecter 0 in flight 2026-02-21T01:27:54.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7acaffd640 10 client.4205.objecter allocate_selfmanaged_snap; pool: 2 2026-02-21T01:27:54.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7acaffd640 10 client.4205.objecter pool_op_submit 4 2026-02-21T01:27:54.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7acaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:54.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:54.805+0000 7f7acaffd640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f7ab4003110 con 0x55fb56dfedd0 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 12 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (unknown 2283778796 0 0) 0x7f7ad00157f0 con 0x55fb56dfedd0 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 pool_op_reply(tid 4 (0) Success v18) 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 client.4205.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v18) 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 client.4205.objecter have request 4 at 0x7f7ab40030a0 Op: create unmanaged snap 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 20 client.4205.objecter waiting for client to reach epoch 18 before calling back 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 monclient: _renew_subs 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=18}) -- 0x55fb56ea3e80 con 0x55fb56dfedd0 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 client.4205.objecter done 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 13 ==== osd_map(18..18 src has 1..18) ==== 629+0+0 (unknown 3087822699 0 0) 0x7f7ad0015a50 con 0x55fb56dfedd0 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_map(18..18 src has 1..18) 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map got epochs [18,18] > 17 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map decoding incremental epoch 18 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7ac97fa640 20 client.4205.objecter dump_active .. 0 homeless 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 20 librados: queue_aio_write 0x55fb56f7fbc0 completion 0x55fb56c7a3a0 write_seq 1 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 10 client.4205.objecter _op_submit op 0x7f7ab00063b0 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 20 client.4205.objecter _calc_target epoch 18 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 20 client.4205.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 10 client.4205.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 20 client.4205.objecter _get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 10 client.4205.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.5 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 20 client.4205.objecter get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 15 client.4205.objecter _session_op_assign 5 5 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 15 client.4205.objecter _send_op 5 to 2.2 on osd.5 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.46:6800/1266691672 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f7ab00069f0 con 0x55fb56f27f60 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:55.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.805+0000 7f7acb7fe640 5 client.4205.objecter 1 in flight 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 1 -- 10.20.193.43:0/3338031291 <== osd.5 v1:10.20.193.46:6800/1266691672 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 2910594948 0 0) 0x7f7acc002820 con 0x55fb56f27f60 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 10 client.4205.objecter in handle_osd_op_reply 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 7 client.4205.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 10 client.4205.objecter op 0 rval 0 len 0 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 10 client.4205.objecter op 1 rval 0 len 0 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 15 client.4205.objecter handle_osd_op_reply completed tid 5 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 15 client.4205.objecter _finish_op 5 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 15 client.4205.objecter _session_op_remove 5 5 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 5 client.4205.objecter 0 in flight 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7ada403640 20 librados: complete_aio_write 0x55fb56c7a3a0 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7acaffd640 10 client.4205.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7acaffd640 10 client.4205.objecter pool_op_submit 6 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7acaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:55.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:55.808+0000 7f7acaffd640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7f7ab40033b0 con 0x55fb56dfedd0 2026-02-21T01:27:56.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 14 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (unknown 2835975163 0 0) 0x7f7ad001ae70 con 0x55fb56dfedd0 2026-02-21T01:27:56.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 pool_op_reply(tid 6 (0) Success v19) 2026-02-21T01:27:56.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 client.4205.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v19) 2026-02-21T01:27:56.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 client.4205.objecter have request 6 at 0x7f7ab40030a0 Op: delete unmanaged snap 2026-02-21T01:27:56.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 20 client.4205.objecter waiting for client to reach epoch 19 before calling back 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 monclient: _renew_subs 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=19}) -- 0x55fb56ea2990 con 0x55fb56dfedd0 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 client.4205.objecter done 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 1 -- 10.20.193.43:0/3338031291 <== mon.2 v1:10.20.193.43:6790/0 15 ==== osd_map(19..19 src has 1..19) ==== 657+0+0 (unknown 45966836 0 0) 0x7f7ad0015c50 con 0x55fb56dfedd0 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_map(19..19 src has 1..19) 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map got epochs [19,19] > 18 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 3 client.4205.objecter handle_osd_map decoding incremental epoch 19 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7ac97fa640 20 client.4205.objecter dump_active .. 0 homeless 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 20 librados: queue_aio_write 0x55fb56f7fbc0 completion 0x7f7ab4001da0 write_seq 2 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 10 client.4205.objecter _op_submit op 0x7f7ab00063b0 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 20 client.4205.objecter _calc_target epoch 19 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 20 client.4205.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 10 client.4205.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 20 client.4205.objecter _get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 10 client.4205.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.5 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 20 client.4205.objecter get_session s=0x55fb56c57280 osd=5 3 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 15 client.4205.objecter _session_op_assign 5 7 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 15 client.4205.objecter _send_op 7 to 2.2 on osd.5 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 1 -- 10.20.193.43:0/3338031291 --> v1:10.20.193.46:6800/1266691672 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f7ab0006db0 con 0x55fb56f27f60 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:56.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.809+0000 7f7acb7fe640 5 client.4205.objecter 1 in flight 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 1 -- 10.20.193.43:0/3338031291 <== osd.5 v1:10.20.193.46:6800/1266691672 5 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 900577457 0 0) 0x7f7acc002820 con 0x55fb56f27f60 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 10 client.4205.objecter ms_dispatch2 0x55fb56cfad50 osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 10 client.4205.objecter in handle_osd_op_reply 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 7 client.4205.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 10 client.4205.objecter op 0 rval 0 len 0 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 15 client.4205.objecter handle_osd_op_reply completed tid 7 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 15 client.4205.objecter _finish_op 7 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 4 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 15 client.4205.objecter _session_op_remove 5 7 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 5 client.4205.objecter 0 in flight 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 20 librados: complete_aio_write 0x7f7ab4001da0 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 10 librados: watch_flush enter 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 10 librados: watch_flush exit 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 10 client.4205.objecter close_session for osd.5 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 >> v1:10.20.193.46:6800/1266691672 conn(0x55fb56f27f60 legacy=0x55fb56f48340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 20 client.4205.objecter put_session s=0x55fb56c57280 osd=5 1 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 20 client.4205.objecter shutdown clearing up homeless session... 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 10 client.4205.objecter successfully canceled tick 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 >> v1:10.20.193.46:6812/860801619 conn(0x7f7ab803d180 legacy=0x7f7ab805d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 10 monclient: shutdown 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 >> v1:10.20.193.43:6790/0 conn(0x55fb56dfedd0 legacy=0x55fb56ebd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada403640 1 -- 10.20.193.43:0/3338031291 reap_dead start 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 shutdown_connections 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 >> 10.20.193.43:0/3338031291 conn(0x55fb56e05170 msgr2=0x55fb56e00780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 shutdown_connections 2026-02-21T01:27:56.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 -- 10.20.193.43:0/3338031291 wait complete. 2026-02-21T01:27:56.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.811+0000 7f7ada6c5300 1 librados: shutdown 2026-02-21T01:27:56.816 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-21T01:27:56.817 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-21T01:27:56.817 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-21T01:27:56.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.926+0000 7fc3c98cd640 10 monclient: get_monmap_and_config 2026-02-21T01:27:56.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.926+0000 7fc3c98cd640 10 monclient: build_initial_monmap 2026-02-21T01:27:56.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.926+0000 7fc3c98cd640 10 monclient: monmap: 2026-02-21T01:27:56.928 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:56.927682+0000 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:56.927682+0000 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:56.929 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.926+0000 7fc3c98cd640 1 Processor -- start 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.926+0000 7fc3c98cd640 1 -- start start 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.926+0000 7fc3c98cd640 10 monclient: init 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient(hunting): picked mon.noname-a con 0x7fc3c4058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient(hunting): picked mon.noname-c con 0x7fc3c4057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient(hunting): picked mon.noname-b con 0x7fc3c4181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c4056c50 con 0x7fc3c4058260 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c408eda0 con 0x7fc3c4057630 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c408f5c0 con 0x7fc3c4181e80 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient(hunting): authenticate will time out at 608.633101s 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c2ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc3c4058260 0x7fc3c408df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36116/0 (socket says 10.20.193.43:36116) 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c2ffd640 1 -- 10.20.193.43:0/1530051230 learned_addr learned my addr 10.20.193.43:0/1530051230 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150669749 0 0) 0x7fc3c4056c50 con 0x7fc3c4058260 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:56.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): my global_id is 4224 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3b0003610 con 0x7fc3c4058260 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417191786 0 0) 0x7fc3c408f5c0 con 0x7fc3c4181e80 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient(hunting): my global_id is 4208 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c4056c50 con 0x7fc3c4181e80 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1399877998 0 0) 0x7fc3b0003610 con 0x7fc3c4058260 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 >> v1:10.20.193.43:6790/0 conn(0x7fc3c4181e80 legacy=0x7fc3c41a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 >> v1:10.20.193.46:6789/0 conn(0x7fc3c4057630 legacy=0x7fc3c408e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 monclient: found mon.noname-a 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c40563b0 con 0x7fc3c4058260 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 5 monclient: authenticate success, global_id 4224 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc3b8002df0 con 0x7fc3c4058260 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: dump: 2026-02-21T01:27:56.934 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3b8003040 con 0x7fc3c4058260 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 1 -- 10.20.193.43:0/1530051230 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc3b8003480 con 0x7fc3c4058260 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 4 set_mon_vals no callback set 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c1ffb640 10 monclient: dump: 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:56.935 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 10 monclient: shutdown 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- 10.20.193.43:0/1530051230 >> v1:10.20.193.43:6789/0 conn(0x7fc3c4058260 legacy=0x7fc3c408df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- 10.20.193.43:0/1530051230 shutdown_connections 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- 10.20.193.43:0/1530051230 >> 10.20.193.43:0/1530051230 conn(0x7fc3c4090360 msgr2=0x7fc3c4090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- 10.20.193.43:0/1530051230 shutdown_connections 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.927+0000 7fc3c98cd640 1 -- 10.20.193.43:0/1530051230 wait complete. 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient: build_initial_monmap 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient: monmap: 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 librados: starting msgr at 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 librados: starting objecter 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 Processor -- start 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 -- start start 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 librados: setting wanted keys 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 librados: calling monclient init 2026-02-21T01:27:56.936 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient: init 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient(hunting): picked mon.noname-a con 0x7fc3c4057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient(hunting): picked mon.noname-c con 0x7fc3c4058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient(hunting): picked mon.noname-b con 0x7fc3c4181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c4149890 con 0x7fc3c4057630 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c408a870 con 0x7fc3c4181e80 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c412fc70 con 0x7fc3c4058260 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c98cd640 10 monclient(hunting): authenticate will time out at 608.634717s 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c2ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc3c4057630 0x7fc3c4149180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36126/0 (socket says 10.20.193.43:36126) 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc3c2ffd640 1 -- 10.20.193.43:0/87149999 learned_addr learned my addr 10.20.193.43:0/87149999 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 client.?.objecter ms_handle_connect 0x7fc3c4057630 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 client.?.objecter ms_handle_connect 0x7fc3c4058260 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053886349 0 0) 0x7fc3c4149890 con 0x7fc3c4057630 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:56.937 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): my global_id is 4227 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc394003610 con 0x7fc3c4057630 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901668430 0 0) 0x7fc3c412fc70 con 0x7fc3c4058260 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 monclient(hunting): my global_id is 4211 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c4149890 con 0x7fc3c4058260 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 client.?.objecter ms_handle_connect 0x7fc3c4181e80 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3744068381 0 0) 0x7fc394003610 con 0x7fc3c4057630 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3c412fc70 con 0x7fc3c4057630 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.928+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc3b8003390 con 0x7fc3c4057630 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): dump: 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2138597690 0 0) 0x7fc3c4149890 con 0x7fc3c4058260 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc394003610 con 0x7fc3c4058260 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc3ac003060 con 0x7fc3c4058260 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): dump: 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.938 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997434403 0 0) 0x7fc3c408a870 con 0x7fc3c4181e80 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient(hunting): my global_id is 4204 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c4149890 con 0x7fc3c4181e80 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 516615525 0 0) 0x7fc3c412fc70 con 0x7fc3c4057630 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 >> v1:10.20.193.43:6790/0 conn(0x7fc3c4058260 legacy=0x7fc3c4170530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 >> v1:10.20.193.46:6789/0 conn(0x7fc3c4181e80 legacy=0x7fc3c4171c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 monclient: found mon.a 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c412e780 con 0x7fc3c4057630 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: _finish_auth 0 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 5 monclient: authenticate success, global_id 4227 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 monclient: _renew_subs 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c4130ae0 con 0x7fc3c4057630 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 client.4227.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 monclient: _renew_subs 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3c414c350 con 0x7fc3c4057630 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 1 librados: init done 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3b8004ce0 con 0x7fc3c4057630 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc3b8005030 con 0x7fc3c4057630 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:56.939 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 monclient: dump: 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c17fa640 4 set_mon_vals no callback set 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fc3b80051d0 con 0x7fc3c4057630 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c40008d0 con 0x7fc3c4057630 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7fc3b804dcd0 con 0x7fc3c4057630 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 10 client.4227.objecter ms_dispatch2 0x7fc3c4000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 3 client.4227.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 3 client.4227.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.929+0000 7fc39bfff640 20 client.4227.objecter dump_active .. 0 homeless 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.930+0000 7fc3c27fc640 10 monclient: get_auth_request con 0x7fc39403eb90 auth_method 0 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.930+0000 7fc39bfff640 10 client.4227.objecter ms_handle_connect 0x7fc39403eb90 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.932+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc3b80176c0 con 0x7fc3c4057630 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.932+0000 7fc39bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:56.940 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:56.932+0000 7fc39bfff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.040+0000 7fc3c98cd640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.041+0000 7fc3c98cd640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.041+0000 7fc3c98cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.041+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fc3c4092830 con 0x7fc3c4057630 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.041+0000 7fc39bfff640 1 -- 10.20.193.43:0/87149999 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7fc3b8016fc0 con 0x7fc3c4057630 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.041+0000 7fc39bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.041+0000 7fc39bfff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:57.043 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 10 librados: watch_flush enter 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 10 librados: watch_flush exit 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 20 client.4227.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 10 client.4227.objecter successfully canceled tick 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 >> v1:10.20.193.46:6812/860801619 conn(0x7fc39403eb90 legacy=0x7fc39405f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 10 monclient: shutdown 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 >> v1:10.20.193.43:6789/0 conn(0x7fc3c4057630 legacy=0x7fc3c4149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 shutdown_connections 2026-02-21T01:27:57.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 >> 10.20.193.43:0/87149999 conn(0x7fc3c4090360 msgr2=0x7fc3c408aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 shutdown_connections 2026-02-21T01:27:57.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 1 -- 10.20.193.43:0/87149999 wait complete. 2026-02-21T01:27:57.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.042+0000 7fc3c98cd640 1 librados: shutdown 2026-02-21T01:27:57.053 INFO:teuthology.orchestra.run.trial043.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-21T01:27:57.053 INFO:tasks.ceph_manager:config epoch is 1 2026-02-21T01:27:57.054 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-21T01:27:57.054 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-21T01:27:57.054 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-21T01:27:57.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.119+0000 7f3c5287c640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.119+0000 7f3c5287c640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.119+0000 7f3c5287c640 10 monclient: monmap: 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.120724+0000 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.120724+0000 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.122 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.119+0000 7f3c5287c640 1 Processor -- start 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.119+0000 7f3c5287c640 1 -- start start 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.119+0000 7f3c5287c640 10 monclient: init 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient(hunting): picked mon.noname-a con 0x7f3c4c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient(hunting): picked mon.noname-c con 0x7f3c4c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient(hunting): picked mon.noname-b con 0x7f3c4c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c08a690 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c08b910 con 0x7f3c4c08d4d0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c088ae0 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient(hunting): authenticate will time out at 608.826098s 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f3c4c08ddb0 0x7f3c4c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36138/0 (socket says 10.20.193.43:36138) 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4bfff640 1 -- 10.20.193.43:0/1927459221 learned_addr learned my addr 10.20.193.43:0/1927459221 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932485143 0 0) 0x7f3c4c08a690 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): my global_id is 4230 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c30003610 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926400468 0 0) 0x7f3c4c088ae0 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient(hunting): my global_id is 4214 2026-02-21T01:27:57.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c4c08a690 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3940013254 0 0) 0x7f3c4c08a690 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 >> v1:10.20.193.46:6789/0 conn(0x7f3c4c08d4d0 legacy=0x7f3c4c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 >> v1:10.20.193.43:6789/0 conn(0x7f3c4c08ddb0 legacy=0x7f3c4c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c1a3ef0 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3c40003170 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 5 monclient: authenticate success, global_id 4214 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: dump: 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c40003470 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 1 -- 10.20.193.43:0/1927459221 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3c400038b0 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 4 set_mon_vals no callback set 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c4affd640 10 monclient: dump: 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 10 monclient: shutdown 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- 10.20.193.43:0/1927459221 >> v1:10.20.193.43:6790/0 conn(0x7f3c4c08d8d0 legacy=0x7f3c4c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- 10.20.193.43:0/1927459221 shutdown_connections 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- 10.20.193.43:0/1927459221 >> 10.20.193.43:0/1927459221 conn(0x7f3c4c08f480 msgr2=0x7f3c4c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- 10.20.193.43:0/1927459221 shutdown_connections 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.120+0000 7f3c5287c640 1 -- 10.20.193.43:0/1927459221 wait complete. 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient: monmap: 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.128 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 librados: starting msgr at 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 librados: starting objecter 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 Processor -- start 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 -- start start 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 librados: setting wanted keys 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 librados: calling monclient init 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient: init 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient(hunting): picked mon.noname-c con 0x7f3c4c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient(hunting): picked mon.noname-b con 0x7f3c4c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient(hunting): picked mon.noname-a con 0x7f3c4c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c057310 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c087380 con 0x7f3c4c08d8d0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c10b9f0 con 0x7f3c4c08d4d0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c5287c640 10 monclient(hunting): authenticate will time out at 608.827633s 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c4bfff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f3c4c08d4d0 0x7f3c4c086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53212/0 (socket says 10.20.193.43:53212) 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c4bfff640 1 -- 10.20.193.43:0/837162605 learned_addr learned my addr 10.20.193.43:0/837162605 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 client.?.objecter ms_handle_connect 0x7f3c4c08d4d0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 client.?.objecter ms_handle_connect 0x7f3c4c08ddb0 2026-02-21T01:27:57.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923828103 0 0) 0x7f3c4c1a3ef0 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): my global_id is 4233 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c1c003610 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828531468 0 0) 0x7f3c4c10b9f0 con 0x7f3c4c08d4d0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): my global_id is 4217 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c4c1a3ef0 con 0x7f3c4c08d4d0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1097653141 0 0) 0x7f3c1c003610 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c4c10b9f0 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3c40003620 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.130 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1927753135 0 0) 0x7f3c4c1a3ef0 con 0x7f3c4c08d4d0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c1c003610 con 0x7f3c4c08d4d0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3c380030b0 con 0x7f3c4c08d4d0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2937387949 0 0) 0x7f3c4c10b9f0 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.121+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 >> v1:10.20.193.43:6790/0 conn(0x7f3c4c08d4d0 legacy=0x7f3c4c086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 >> v1:10.20.193.46:6789/0 conn(0x7f3c4c08d8d0 legacy=0x7f3c4c086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 1 monclient: found mon.a 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c056fc0 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.131 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 client.?.objecter ms_handle_connect 0x7f3c4c08d8d0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 5 monclient: authenticate success, global_id 4233 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 monclient: _renew_subs 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c05e1b0 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 client.4233.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 monclient: _renew_subs 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c4c10b710 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 1 librados: init done 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c40003960 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3c40003e80 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 monclient: dump: 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c4a7fc640 4 set_mon_vals no callback set 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.132 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c08edd0 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f3c40010800 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f3c4004cd80 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 10 client.4233.objecter ms_dispatch2 0x7f3c4c000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 3 client.4233.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 3 client.4233.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.122+0000 7f3c48ff9640 20 client.4233.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.123+0000 7f3c4bfff640 10 monclient: get_auth_request con 0x7f3c1c03e980 auth_method 0 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.123+0000 7f3c48ff9640 10 client.4233.objecter ms_handle_connect 0x7f3c1c03e980 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.125+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3c4c057310 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.125+0000 7f3c48ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.133 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.125+0000 7f3c48ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:57.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.261+0000 7f3c5287c640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-21T01:27:57.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.261+0000 7f3c5287c640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-21T01:27:57.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.261+0000 7f3c5287c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.261+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3c4c08a680 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.262+0000 7f3c48ff9640 1 -- 10.20.193.43:0/837162605 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97380 (unknown 481731318 0 1280058709) 0x7f3c400168b0 con 0x7f3c4c08ddb0 2026-02-21T01:27:57.266 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.262+0000 7f3c48ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-21T01:27:57.266 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.262+0000 7f3c48ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:57.266 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 10 librados: watch_flush enter 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 10 librados: watch_flush exit 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 20 client.4233.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 10 client.4233.objecter successfully canceled tick 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 >> v1:10.20.193.46:6812/860801619 conn(0x7f3c1c03e980 legacy=0x7f3c1c05ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 10 monclient: shutdown 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 >> v1:10.20.193.43:6789/0 conn(0x7f3c4c08ddb0 legacy=0x7f3c4c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 shutdown_connections 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 >> 10.20.193.43:0/837162605 conn(0x7f3c4c08f480 msgr2=0x7f3c4c11f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 shutdown_connections 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 1 -- 10.20.193.43:0/837162605 wait complete. 2026-02-21T01:27:57.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.263+0000 7f3c5287c640 1 librados: shutdown 2026-02-21T01:27:57.273 INFO:teuthology.orchestra.run.trial043.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6812","nonce":860801619}]},"active_addr":"10.20.193.46:6812/860801619","active_change":"2026-02-21T01:27:46.610080+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":878597526}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":3379233875}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":1525827963}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.46:0","nonce":1576316170}]}]} 2026-02-21T01:27:57.278 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-21T01:27:57.278 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-21T01:27:57.278 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-21T01:27:57.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.343+0000 7f8d6c016640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.343+0000 7f8d6c016640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.343+0000 7f8d6c016640 10 monclient: monmap: 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.344870+0000 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.344870+0000 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.347 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.343+0000 7f8d6c016640 1 Processor -- start 2026-02-21T01:27:57.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.343+0000 7f8d6c016640 1 -- start start 2026-02-21T01:27:57.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.343+0000 7f8d6c016640 10 monclient: init 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient(hunting): picked mon.noname-b con 0x7f8d6408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient(hunting): picked mon.noname-a con 0x7f8d6408d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient(hunting): picked mon.noname-c con 0x7f8d6408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6408a690 con 0x7f8d6408d4d0 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6408b910 con 0x7f8d6408d8d0 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d64088ae0 con 0x7f8d6408ddb0 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient(hunting): authenticate will time out at 609.050296s 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d69d8b640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f8d6408ddb0 0x7f8d6408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53216/0 (socket says 10.20.193.43:53216) 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d69d8b640 1 -- 10.20.193.43:0/2322599055 learned_addr learned my addr 10.20.193.43:0/2322599055 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6958a640 1 --1- 10.20.193.43:0/2322599055 >> v1:10.20.193.43:6789/0 conn(0x7f8d6408d4d0 0x7f8d6417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36156/0 (socket says 10.20.193.43:36156) 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113976327 0 0) 0x7f8d64088ae0 con 0x7f8d6408ddb0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): my global_id is 4220 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d4c003610 con 0x7f8d6408ddb0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784759838 0 0) 0x7f8d6408a690 con 0x7f8d6408d4d0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient(hunting): my global_id is 4236 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d64088ae0 con 0x7f8d6408d4d0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1984461592 0 0) 0x7f8d4c003610 con 0x7f8d6408ddb0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 >> v1:10.20.193.46:6789/0 conn(0x7f8d6408d8d0 legacy=0x7f8d6419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 >> v1:10.20.193.43:6789/0 conn(0x7f8d6408d4d0 legacy=0x7f8d6417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d641a3ef0 con 0x7f8d6408ddb0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8d54002df0 con 0x7f8d6408ddb0 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 5 monclient: authenticate success, global_id 4220 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: dump: 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d54003030 con 0x7f8d6408ddb0 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 1 -- 10.20.193.43:0/2322599055 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8d54003470 con 0x7f8d6408ddb0 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 4 set_mon_vals no callback set 2026-02-21T01:27:57.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d68d89640 10 monclient: dump: 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 10 monclient: shutdown 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.344+0000 7f8d6c016640 1 -- 10.20.193.43:0/2322599055 >> v1:10.20.193.43:6790/0 conn(0x7f8d6408ddb0 legacy=0x7f8d6408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- 10.20.193.43:0/2322599055 shutdown_connections 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- 10.20.193.43:0/2322599055 >> 10.20.193.43:0/2322599055 conn(0x7f8d6408f480 msgr2=0x7f8d6408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- 10.20.193.43:0/2322599055 shutdown_connections 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- 10.20.193.43:0/2322599055 wait complete. 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient: monmap: 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.356 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 librados: starting msgr at 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 librados: starting objecter 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 Processor -- start 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- start start 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 librados: setting wanted keys 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 librados: calling monclient init 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient: init 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient(hunting): picked mon.noname-b con 0x7f8d6408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient(hunting): picked mon.noname-a con 0x7f8d6408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient(hunting): picked mon.noname-c con 0x7f8d6408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6410c860 con 0x7f8d6408d8d0 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d64087ee0 con 0x7f8d6408d4d0 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6405e1b0 con 0x7f8d6408ddb0 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6c016640 10 monclient(hunting): authenticate will time out at 609.051861s 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6958a640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f8d6408d8d0 0x7f8d64086c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36162/0 (socket says 10.20.193.43:36162) 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d6958a640 1 -- 10.20.193.43:0/2182570810 learned_addr learned my addr 10.20.193.43:0/2182570810 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 client.?.objecter ms_handle_connect 0x7f8d6408d8d0 2026-02-21T01:27:57.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 client.?.objecter ms_handle_connect 0x7f8d6408ddb0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805855704 0 0) 0x7f8d6410c860 con 0x7f8d6408d8d0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.345+0000 7f8d527fc640 10 monclient(hunting): my global_id is 4239 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d34003610 con 0x7f8d6408d8d0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787156880 0 0) 0x7f8d6405e1b0 con 0x7f8d6408ddb0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): my global_id is 4223 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d6410c860 con 0x7f8d6408ddb0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3058343636 0 0) 0x7f8d34003610 con 0x7f8d6408d8d0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d6405e1b0 con 0x7f8d6408d8d0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 915226431 0 0) 0x7f8d6410c860 con 0x7f8d6408ddb0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d34003610 con 0x7f8d6408ddb0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8d58003260 con 0x7f8d6408d8d0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): dump: 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.358 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8d600032c0 con 0x7f8d6408ddb0 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient(hunting): dump: 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 client.?.objecter ms_handle_connect 0x7f8d6408d4d0 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1413407843 0 0) 0x7f8d6405e1b0 con 0x7f8d6408d8d0 2026-02-21T01:27:57.359 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 >> v1:10.20.193.43:6790/0 conn(0x7f8d6408ddb0 legacy=0x7f8d64087380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 >> v1:10.20.193.46:6789/0 conn(0x7f8d6408d4d0 legacy=0x7f8d64086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 monclient: found mon.a 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6410c580 con 0x7f8d6408d8d0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 5 monclient: authenticate success, global_id 4239 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 monclient: _renew_subs 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6418fc10 con 0x7f8d6408d8d0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d580034f0 con 0x7f8d6408d8d0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 client.4239.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8d58004d20 con 0x7f8d6408d8d0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d53fff640 4 set_mon_vals no callback set 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 10 monclient: dump: 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.360 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 monclient: _renew_subs 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d64190180 con 0x7f8d6408d8d0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 1 librados: init done 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6408edb0 con 0x7f8d6408d8d0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.346+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f8d580116a0 con 0x7f8d6408d8d0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.347+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f8d5804dde0 con 0x7f8d6408d8d0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.347+0000 7f8d527fc640 10 client.4239.objecter ms_dispatch2 0x7f8d64000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.347+0000 7f8d527fc640 3 client.4239.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.347+0000 7f8d527fc640 3 client.4239.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.347+0000 7f8d527fc640 20 client.4239.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.347+0000 7f8d69d8b640 10 monclient: get_auth_request con 0x7f8d3403e8a0 auth_method 0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.347+0000 7f8d527fc640 10 client.4239.objecter ms_handle_connect 0x7f8d3403e8a0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.349+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8d58017790 con 0x7f8d6408d8d0 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.349+0000 7f8d527fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.361 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.349+0000 7f8d527fc640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:57.461 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.459+0000 7f8d6c016640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:57.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.459+0000 7f8d6c016640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:57.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.459+0000 7f8d6c016640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.459+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d64054ff0 con 0x7f8d6408d8d0 2026-02-21T01:27:57.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.459+0000 7f8d527fc640 1 -- 10.20.193.43:0/2182570810 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10985 (unknown 941590788 0 1197052247) 0x7f8d58017090 con 0x7f8d6408d8d0 2026-02-21T01:27:57.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.459+0000 7f8d527fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:57.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.459+0000 7f8d527fc640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:57.462 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:57.463 INFO:teuthology.orchestra.run.trial043.stdout:{"epoch":19,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","created":"2026-02-21T01:27:44.582175+0000","modified":"2026-02-21T01:27:56.807274+0000","last_up_change":"2026-02-21T01:27:48.746376+0000","last_in_change":"2026-02-21T01:27:45.744393+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-21T01:27:50.628015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-21T01:27:53.551352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e67289af-bac2-443d-83b5-4766298e9303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6800","nonce":1072173340}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6801","nonce":1072173340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6803","nonce":1072173340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6802","nonce":1072173340}]},"public_addr":"10.20.193.43:6800/1072173340","cluster_addr":"10.20.193.43:6801/1072173340","heartbeat_back_addr":"10.20.193.43:6803/1072173340","heartbeat_front_addr":"10.20.193.43:6802/1072173340","state":["exists","up"]},{"osd":1,"uuid":"4207f5e8-3ce8-4f55-bb23-a8605d56d872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6808","nonce":3522371706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6809","nonce":3522371706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6811","nonce":3522371706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6810","nonce":3522371706}]},"public_addr":"10.20.193.43:6808/3522371706","cluster_addr":"10.20.193.43:6809/3522371706","heartbeat_back_addr":"10.20.193.43:6811/3522371706","heartbeat_front_addr":"10.20.193.43:6810/3522371706","state":["exists","up"]},{"osd":2,"uuid":"da0c4995-e8bf-480e-876d-be10b4196751","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6804","nonce":3123352217}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6805","nonce":3123352217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6807","nonce":3123352217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6806","nonce":3123352217}]},"public_addr":"10.20.193.43:6804/3123352217","cluster_addr":"10.20.193.43:6805/3123352217","heartbeat_back_addr":"10.20.193.43:6807/3123352217","heartbeat_front_addr":"10.20.193.43:6806/3123352217","state":["exists","up"]},{"osd":3,"uuid":"2cb6a730-2373-4354-904c-57509d260325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6808","nonce":3250452844}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6809","nonce":3250452844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6811","nonce":3250452844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6810","nonce":3250452844}]},"public_addr":"10.20.193.46:6808/3250452844","cluster_addr":"10.20.193.46:6809/3250452844","heartbeat_back_addr":"10.20.193.46:6811/3250452844","heartbeat_front_addr":"10.20.193.46:6810/3250452844","state":["exists","up"]},{"osd":4,"uuid":"22624587-71c2-4992-b8bb-6ff8f9fad066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6802","nonce":3807500891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6804","nonce":3807500891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6807","nonce":3807500891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6806","nonce":3807500891}]},"public_addr":"10.20.193.46:6802/3807500891","cluster_addr":"10.20.193.46:6804/3807500891","heartbeat_back_addr":"10.20.193.46:6807/3807500891","heartbeat_front_addr":"10.20.193.46:6806/3807500891","state":["exists","up"]},{"osd":5,"uuid":"b7f8c29f-504c-4cfe-b959-03fe02b39f69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6800","nonce":1266691672}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6801","nonce":1266691672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6805","nonce":1266691672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6803","nonce":1266691672}]},"public_addr":"10.20.193.46:6800/1266691672","cluster_addr":"10.20.193.46:6801/1266691672","heartbeat_back_addr":"10.20.193.46:6805/1266691672","heartbeat_front_addr":"10.20.193.46:6803/1266691672","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.465320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.517324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.541306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.629304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.660956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.636067+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 10 librados: watch_flush enter 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 10 librados: watch_flush exit 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 20 client.4239.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 10 client.4239.objecter successfully canceled tick 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 >> v1:10.20.193.46:6812/860801619 conn(0x7f8d3403e8a0 legacy=0x7f8d3405ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 10 monclient: shutdown 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 >> v1:10.20.193.43:6789/0 conn(0x7f8d6408d8d0 legacy=0x7f8d64086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 shutdown_connections 2026-02-21T01:27:57.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 >> 10.20.193.43:0/2182570810 conn(0x7f8d6408f480 msgr2=0x7f8d641a2740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 shutdown_connections 2026-02-21T01:27:57.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 1 -- 10.20.193.43:0/2182570810 wait complete. 2026-02-21T01:27:57.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.460+0000 7f8d6c016640 1 librados: shutdown 2026-02-21T01:27:57.471 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-21T01:27:57.471 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.535+0000 7f4bb2ea6640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.535+0000 7f4bb2ea6640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.535+0000 7f4bb2ea6640 10 monclient: monmap: 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.537028+0000 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.537028+0000 2026-02-21T01:27:57.538 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.539 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.539 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.539 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.539 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.539 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 1 Processor -- start 2026-02-21T01:27:57.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 1 -- start start 2026-02-21T01:27:57.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient: init 2026-02-21T01:27:57.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient(hunting): picked mon.noname-b con 0x7f4bac08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient(hunting): picked mon.noname-a con 0x7f4bac08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient(hunting): picked mon.noname-c con 0x7f4bac08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac08a690 con 0x7f4bac08d4d0 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac08b910 con 0x7f4bac08d8d0 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac088ae0 con 0x7f4bac08ddb0 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient(hunting): authenticate will time out at 609.242469s 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb0c1b640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f4bac08ddb0 0x7f4bac08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53238/0 (socket says 10.20.193.43:53238) 2026-02-21T01:27:57.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb0c1b640 1 -- 10.20.193.43:0/3348091384 learned_addr learned my addr 10.20.193.43:0/3348091384 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224097807 0 0) 0x7f4bac088ae0 con 0x7f4bac08ddb0 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): my global_id is 4226 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b98003610 con 0x7f4bac08ddb0 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030490190 0 0) 0x7f4bac08a690 con 0x7f4bac08d4d0 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient(hunting): my global_id is 4242 2026-02-21T01:27:57.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bac088ae0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3241650865 0 0) 0x7f4b98003610 con 0x7f4bac08ddb0 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 >> v1:10.20.193.46:6789/0 conn(0x7f4bac08d8d0 legacy=0x7f4bac19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 >> v1:10.20.193.43:6789/0 conn(0x7f4bac08d4d0 legacy=0x7f4bac17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac1a3ef0 con 0x7f4bac08ddb0 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4b9c002df0 con 0x7f4bac08ddb0 2026-02-21T01:27:57.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 5 monclient: authenticate success, global_id 4226 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: dump: 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.551 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b9c003030 con 0x7f4bac08ddb0 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 1 -- 10.20.193.43:0/3348091384 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4b9c003470 con 0x7f4bac08ddb0 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4bb2ea6640 4 set_mon_vals no callback set 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.536+0000 7f4ba37fe640 10 monclient: dump: 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.552 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 10 monclient: shutdown 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3348091384 >> v1:10.20.193.43:6790/0 conn(0x7f4bac08ddb0 legacy=0x7f4bac08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3348091384 shutdown_connections 2026-02-21T01:27:57.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3348091384 >> 10.20.193.43:0/3348091384 conn(0x7f4bac08f480 msgr2=0x7f4bac08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3348091384 shutdown_connections 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3348091384 wait complete. 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 10 monclient: monmap: 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.554 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 librados: starting msgr at 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 librados: starting objecter 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 Processor -- start 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 -- start start 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 librados: setting wanted keys 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 1 librados: calling monclient init 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 10 monclient: init 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.537+0000 7f4bb2ea6640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient(hunting): picked mon.noname-a con 0x7f4bac08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient(hunting): picked mon.noname-c con 0x7f4bac08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient(hunting): picked mon.noname-b con 0x7f4bac08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac10db90 con 0x7f4bac08d4d0 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac057680 con 0x7f4bac08ddb0 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac05e1b0 con 0x7f4bac08d8d0 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient(hunting): authenticate will time out at 609.244051s 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb0c1b640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f4bac08d4d0 0x7f4bac086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36172/0 (socket says 10.20.193.43:36172) 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb0c1b640 1 -- 10.20.193.43:0/3080616998 learned_addr learned my addr 10.20.193.43:0/3080616998 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 client.?.objecter ms_handle_connect 0x7f4bac08d8d0 2026-02-21T01:27:57.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 client.?.objecter ms_handle_connect 0x7f4bac08d4d0 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432958063 0 0) 0x7f4bac10db90 con 0x7f4bac08d4d0 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): my global_id is 4245 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b7c003610 con 0x7f4bac08d4d0 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626844819 0 0) 0x7f4bac05e1b0 con 0x7f4bac08d8d0 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): my global_id is 4229 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bac10db90 con 0x7f4bac08d8d0 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2404545830 0 0) 0x7f4b7c003610 con 0x7f4bac08d4d0 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4bac05e1b0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4b9c003380 con 0x7f4bac08d4d0 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): dump: 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.558 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2432682604 0 0) 0x7f4bac10db90 con 0x7f4bac08d8d0 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b7c003610 con 0x7f4bac08d8d0 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4b94002fa0 con 0x7f4bac08d8d0 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient(hunting): dump: 2026-02-21T01:27:57.559 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2948338732 0 0) 0x7f4bac05e1b0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 >> v1:10.20.193.43:6790/0 conn(0x7f4bac08d8d0 legacy=0x7f4bac086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 >> v1:10.20.193.46:6789/0 conn(0x7f4bac08ddb0 legacy=0x7f4bac18ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 monclient: found mon.a 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac0876f0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 5 monclient: authenticate success, global_id 4245 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient: _renew_subs 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4bac088000 con 0x7f4bac08d4d0 2026-02-21T01:27:57.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 client.4245.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient: _renew_subs 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4bac087380 con 0x7f4bac08d4d0 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 1 librados: init done 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b9c004ce0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4b9c004e90 con 0x7f4bac08d4d0 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba2ffd640 4 set_mon_vals no callback set 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4ba17fa640 10 monclient: dump: 2026-02-21T01:27:57.562 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.538+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bac08edd0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f4b9c011810 con 0x7f4bac08d4d0 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f4b9c04dd70 con 0x7f4bac08d4d0 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba17fa640 10 client.4245.objecter ms_dispatch2 0x7f4bac000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba17fa640 3 client.4245.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba17fa640 3 client.4245.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba17fa640 20 client.4245.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba3fff640 10 monclient: get_auth_request con 0x7f4b7c03eab0 auth_method 0 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.539+0000 7f4ba17fa640 10 client.4245.objecter ms_handle_connect 0x7f4b7c03eab0 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.541+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4b9c0177e0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.541+0000 7f4ba17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.541+0000 7f4ba17fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:57.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.654+0000 7f4bb2ea6640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:57.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.654+0000 7f4bb2ea6640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:57.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.654+0000 7f4bb2ea6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.654+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bac1a10d0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.654+0000 7f4ba17fa640 1 -- 10.20.193.43:0/3080616998 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10985 (unknown 941590788 0 1197052247) 0x7f4b9c0170e0 con 0x7f4bac08d4d0 2026-02-21T01:27:57.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.654+0000 7f4ba17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:27:57.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.654+0000 7f4ba17fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:57.657 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:57.657 INFO:teuthology.orchestra.run.trial043.stdout:{"epoch":19,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","created":"2026-02-21T01:27:44.582175+0000","modified":"2026-02-21T01:27:56.807274+0000","last_up_change":"2026-02-21T01:27:48.746376+0000","last_in_change":"2026-02-21T01:27:45.744393+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-21T01:27:50.628015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-21T01:27:53.551352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e67289af-bac2-443d-83b5-4766298e9303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6800","nonce":1072173340}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6801","nonce":1072173340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6803","nonce":1072173340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6802","nonce":1072173340}]},"public_addr":"10.20.193.43:6800/1072173340","cluster_addr":"10.20.193.43:6801/1072173340","heartbeat_back_addr":"10.20.193.43:6803/1072173340","heartbeat_front_addr":"10.20.193.43:6802/1072173340","state":["exists","up"]},{"osd":1,"uuid":"4207f5e8-3ce8-4f55-bb23-a8605d56d872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6808","nonce":3522371706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6809","nonce":3522371706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6811","nonce":3522371706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6810","nonce":3522371706}]},"public_addr":"10.20.193.43:6808/3522371706","cluster_addr":"10.20.193.43:6809/3522371706","heartbeat_back_addr":"10.20.193.43:6811/3522371706","heartbeat_front_addr":"10.20.193.43:6810/3522371706","state":["exists","up"]},{"osd":2,"uuid":"da0c4995-e8bf-480e-876d-be10b4196751","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6804","nonce":3123352217}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6805","nonce":3123352217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6807","nonce":3123352217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6806","nonce":3123352217}]},"public_addr":"10.20.193.43:6804/3123352217","cluster_addr":"10.20.193.43:6805/3123352217","heartbeat_back_addr":"10.20.193.43:6807/3123352217","heartbeat_front_addr":"10.20.193.43:6806/3123352217","state":["exists","up"]},{"osd":3,"uuid":"2cb6a730-2373-4354-904c-57509d260325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6808","nonce":3250452844}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6809","nonce":3250452844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6811","nonce":3250452844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6810","nonce":3250452844}]},"public_addr":"10.20.193.46:6808/3250452844","cluster_addr":"10.20.193.46:6809/3250452844","heartbeat_back_addr":"10.20.193.46:6811/3250452844","heartbeat_front_addr":"10.20.193.46:6810/3250452844","state":["exists","up"]},{"osd":4,"uuid":"22624587-71c2-4992-b8bb-6ff8f9fad066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6802","nonce":3807500891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6804","nonce":3807500891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6807","nonce":3807500891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6806","nonce":3807500891}]},"public_addr":"10.20.193.46:6802/3807500891","cluster_addr":"10.20.193.46:6804/3807500891","heartbeat_back_addr":"10.20.193.46:6807/3807500891","heartbeat_front_addr":"10.20.193.46:6806/3807500891","state":["exists","up"]},{"osd":5,"uuid":"b7f8c29f-504c-4cfe-b959-03fe02b39f69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6800","nonce":1266691672}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6801","nonce":1266691672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6805","nonce":1266691672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6803","nonce":1266691672}]},"public_addr":"10.20.193.46:6800/1266691672","cluster_addr":"10.20.193.46:6801/1266691672","heartbeat_back_addr":"10.20.193.46:6805/1266691672","heartbeat_front_addr":"10.20.193.46:6803/1266691672","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.465320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.517324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.541306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.629304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.660956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.636067+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-21T01:27:57.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 10 librados: watch_flush enter 2026-02-21T01:27:57.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 10 librados: watch_flush exit 2026-02-21T01:27:57.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 20 client.4245.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 10 client.4245.objecter successfully canceled tick 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 >> v1:10.20.193.46:6812/860801619 conn(0x7f4b7c03eab0 legacy=0x7f4b7c05ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 10 monclient: shutdown 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 >> v1:10.20.193.43:6789/0 conn(0x7f4bac08d4d0 legacy=0x7f4bac086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 shutdown_connections 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 >> 10.20.193.43:0/3080616998 conn(0x7f4bac08f480 msgr2=0x7f4bac1a2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 shutdown_connections 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 1 -- 10.20.193.43:0/3080616998 wait complete. 2026-02-21T01:27:57.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.655+0000 7f4bb2ea6640 1 librados: shutdown 2026-02-21T01:27:57.665 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-21T01:27:57.666 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-21T01:27:57.667 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-21T01:27:57.667 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-21T01:27:57.668 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-21T01:27:57.668 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-21T01:27:57.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient: monmap: 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.736587+0000 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.736587+0000 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.738 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.739 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.739 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.739 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f410a09f640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f410a09f640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f410a09f640 10 monclient: monmap: 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.736763+0000 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.736763+0000 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.740 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 1 Processor -- start 2026-02-21T01:27:57.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 1 -- start start 2026-02-21T01:27:57.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient: init 2026-02-21T01:27:57.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7fe941432640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7fe941432640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7fe941432640 10 monclient: monmap: 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.737149+0000 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.737149+0000 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.742 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.743 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f410a09f640 1 Processor -- start 2026-02-21T01:27:57.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:57.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient(hunting): picked mon.noname-c con 0x7f16f013efc0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient(hunting): picked mon.noname-b con 0x7f16f008de90 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 10 monclient(hunting): picked mon.noname-a con 0x7f16f013faa0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.736+0000 7f16f67eb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f008e910 con 0x7f16f013faa0 2026-02-21T01:27:57.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 1 -- start start 2026-02-21T01:27:57.745 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient: init 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f008ebf0 con 0x7f16f013efc0 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f008eed0 con 0x7f16f008de90 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 10 monclient(hunting): authenticate will time out at 609.442023s 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f4d61640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f16f013faa0 0x7f16f01a1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36184/0 (socket says 10.20.193.43:36184) 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f4d61640 1 -- 10.20.193.43:0/2879053403 learned_addr learned my addr 10.20.193.43:0/2879053403 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16ef7fe640 1 --1- 10.20.193.43:0/2879053403 >> v1:10.20.193.43:6790/0 conn(0x7f16f008de90 0x7f16f01804f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53262/0 (socket says 10.20.193.43:53262) 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118995411 0 0) 0x7f16f008e910 con 0x7f16f013faa0 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.746 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): my global_id is 4248 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16d4003610 con 0x7f16f013faa0 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793127432 0 0) 0x7f16f008eed0 con 0x7f16f008de90 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient(hunting): my global_id is 4232 2026-02-21T01:27:57.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f008e910 con 0x7f16f008de90 2026-02-21T01:27:57.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 1 Processor -- start 2026-02-21T01:27:57.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 1 -- start start 2026-02-21T01:27:57.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient: init 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 149274110 0 0) 0x7f16d4003610 con 0x7f16f013faa0 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 >> v1:10.20.193.43:6790/0 conn(0x7f16f008de90 legacy=0x7f16f01804f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 >> v1:10.20.193.46:6789/0 conn(0x7f16f013efc0 legacy=0x7f16f013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 monclient: found mon.noname-a 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f008f1b0 con 0x7f16f013faa0 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f16e4003170 con 0x7f16f013faa0 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: dump: 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.750 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.751 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.751 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.751 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.751 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.751 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 5 monclient: authenticate success, global_id 4248 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f6339fbb640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f6339fbb640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f6339fbb640 10 monclient: monmap: 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.752 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.737859+0000 2026-02-21T01:27:57.753 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.737859+0000 2026-02-21T01:27:57.753 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.753 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.753 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.753 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.753 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.753 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.754 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:57.754 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient(hunting): picked mon.noname-a con 0x7f410405d520 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.754 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient(hunting): picked mon.noname-b con 0x7f41040870c0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.754 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient(hunting): picked mon.noname-c con 0x7f4104087ad0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.754 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f410408ca40 con 0x7f410405d520 2026-02-21T01:27:57.754 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16e4003380 con 0x7f16f013faa0 2026-02-21T01:27:57.755 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.755 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4104086120 con 0x7f4104087ad0 2026-02-21T01:27:57.755 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 1 -- 10.20.193.43:0/2879053403 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f16e40037c0 con 0x7f16f013faa0 2026-02-21T01:27:57.755 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.755 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 4 set_mon_vals no callback set 2026-02-21T01:27:57.756 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.756 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.756 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4104086400 con 0x7f41040870c0 2026-02-21T01:27:57.756 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16eeffd640 10 monclient: dump: 2026-02-21T01:27:57.756 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.757 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.758 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.758 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 10 monclient(hunting): authenticate will time out at 609.442652s 2026-02-21T01:27:57.758 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f4102ffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f41040870c0 0x7f410408c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53266/0 (socket says 10.20.193.43:53266) 2026-02-21T01:27:57.758 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f4102ffd640 1 -- 10.20.193.43:0/1427053735 learned_addr learned my addr 10.20.193.43:0/1427053735 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.758 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fd4a0cae640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fd4a0cae640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fd4a0cae640 10 monclient: monmap: 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.738024+0000 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.738024+0000 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.759 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.760 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.760 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.760 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 10 monclient: shutdown 2026-02-21T01:27:57.760 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.760 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 1 -- 10.20.193.43:0/2879053403 >> v1:10.20.193.43:6789/0 conn(0x7f16f013faa0 legacy=0x7f16f01a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222761009 0 0) 0x7f4104086400 con 0x7f41040870c0 2026-02-21T01:27:57.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): my global_id is 4235 2026-02-21T01:27:57.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40e8003610 con 0x7f41040870c0 2026-02-21T01:27:57.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969886574 0 0) 0x7f410408ca40 con 0x7f410405d520 2026-02-21T01:27:57.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient(hunting): my global_id is 4251 2026-02-21T01:27:57.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:57.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4104086400 con 0x7f410405d520 2026-02-21T01:27:57.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 1 -- 10.20.193.43:0/2879053403 shutdown_connections 2026-02-21T01:27:57.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 1 -- 10.20.193.43:0/2879053403 >> 10.20.193.43:0/2879053403 conn(0x7f16f0093d40 msgr2=0x7f16f008ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient(hunting): picked mon.noname-b con 0x7fe93c05d520 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient(hunting): picked mon.noname-a con 0x7fe93c08c330 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 1 -- 10.20.193.43:0/2879053403 shutdown_connections 2026-02-21T01:27:57.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient(hunting): picked mon.noname-c con 0x7fe93c08c770 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f16f67eb640 1 -- 10.20.193.43:0/2879053403 wait complete. 2026-02-21T01:27:57.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c0863a0 con 0x7fe93c08c330 2026-02-21T01:27:57.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c08d190 con 0x7fe93c08c770 2026-02-21T01:27:57.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1743939755 0 0) 0x7f4104086400 con 0x7f410405d520 2026-02-21T01:27:57.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 >> v1:10.20.193.43:6790/0 conn(0x7f41040870c0 legacy=0x7f410408c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c090e80 con 0x7fe93c05d520 2026-02-21T01:27:57.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe941432640 10 monclient(hunting): authenticate will time out at 609.442972s 2026-02-21T01:27:57.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe93affd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fe93c05d520 0x7fe93c08bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53270/0 (socket says 10.20.193.43:53270) 2026-02-21T01:27:57.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7fe93affd640 1 -- 10.20.193.43:0/3588551244 learned_addr learned my addr 10.20.193.43:0/3588551244 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 >> v1:10.20.193.46:6789/0 conn(0x7f4104087ad0 legacy=0x7f410419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 monclient: found mon.noname-a 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41040866e0 con 0x7f410405d520 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f41027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 5 monclient: authenticate success, global_id 4251 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.737+0000 7f410a09f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f40f0002d70 con 0x7f410405d520 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 10 monclient: dump: 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.769 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.770 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 1 Processor -- start 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f40f0002fc0 con 0x7f410405d520 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 1 -- 10.20.193.43:0/1427053735 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f40f0003400 con 0x7f410405d520 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f41027fc640 10 monclient: dump: 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.771 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 4 set_mon_vals no callback set 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 1 -- start start 2026-02-21T01:27:57.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient: init 2026-02-21T01:27:57.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 1 Processor -- start 2026-02-21T01:27:57.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885620088 0 0) 0x7fe93c090e80 con 0x7fe93c05d520 2026-02-21T01:27:57.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): my global_id is 4238 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe928003610 con 0x7fe93c05d520 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764897585 0 0) 0x7fe93c0863a0 con 0x7fe93c08c330 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient(hunting): my global_id is 4254 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe93c090e80 con 0x7fe93c08c330 2026-02-21T01:27:57.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 1 -- start start 2026-02-21T01:27:57.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient: init 2026-02-21T01:27:57.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1180384859 0 0) 0x7fe93c090e80 con 0x7fe93c08c330 2026-02-21T01:27:57.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 >> v1:10.20.193.43:6790/0 conn(0x7fe93c05d520 legacy=0x7fe93c08bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 >> v1:10.20.193.46:6789/0 conn(0x7fe93c08c770 legacy=0x7fe93c1a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 monclient: found mon.noname-a 2026-02-21T01:27:57.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 10 monclient: shutdown 2026-02-21T01:27:57.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c05d8f0 con 0x7fe93c08c330 2026-02-21T01:27:57.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe924002df0 con 0x7fe93c08c330 2026-02-21T01:27:57.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 1 -- 10.20.193.43:0/1427053735 >> v1:10.20.193.43:6789/0 conn(0x7f410405d520 legacy=0x7f410408bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: dump: 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 5 monclient: authenticate success, global_id 4254 2026-02-21T01:27:57.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 1 -- 10.20.193.43:0/1427053735 shutdown_connections 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 1 -- 10.20.193.43:0/1427053735 >> 10.20.193.43:0/1427053735 conn(0x7f4104091aa0 msgr2=0x7f410408dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient: monmap: 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.779 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 1 -- 10.20.193.43:0/1427053735 shutdown_connections 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe924003030 con 0x7fe93c08c330 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 1 -- 10.20.193.43:0/3588551244 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe924003470 con 0x7fe93c08c330 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 1 -- 10.20.193.43:0/1427053735 wait complete. 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe939ffb640 10 monclient: dump: 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.781 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 4 set_mon_vals no callback set 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 librados: starting msgr at 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 librados: starting objecter 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:57.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient(hunting): picked mon.noname-b con 0x7f6334058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:57.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient(hunting): picked mon.noname-a con 0x7f6334057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient(hunting): picked mon.noname-c con 0x7f6334181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 Processor -- start 2026-02-21T01:27:57.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6334056c50 con 0x7f6334057630 2026-02-21T01:27:57.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient(hunting): picked mon.noname-b con 0x7fd49c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633408eda0 con 0x7f6334181e80 2026-02-21T01:27:57.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c08a690 con 0x7fd49c08ddb0 2026-02-21T01:27:57.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c08b910 con 0x7fd49c08d4d0 2026-02-21T01:27:57.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c088ae0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633408f5c0 con 0x7f6334058260 2026-02-21T01:27:57.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient(hunting): authenticate will time out at 609.443584s 2026-02-21T01:27:57.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 10 monclient(hunting): authenticate will time out at 609.443577s 2026-02-21T01:27:57.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 -- start start 2026-02-21T01:27:57.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 librados: setting wanted keys 2026-02-21T01:27:57.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6332ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6334057630 0x7f633408e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36210/0 (socket says 10.20.193.43:36210) 2026-02-21T01:27:57.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6332ffd640 1 -- 10.20.193.43:0/1489423067 learned_addr learned my addr 10.20.193.43:0/1489423067 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63337fe640 1 --1- 10.20.193.43:0/1489423067 >> v1:10.20.193.43:6790/0 conn(0x7f6334058260 0x7f633408df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53282/0 (socket says 10.20.193.43:53282) 2026-02-21T01:27:57.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 librados: calling monclient init 2026-02-21T01:27:57.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient: init 2026-02-21T01:27:57.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd49a575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd49c08ddb0 0x7fd49c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36214/0 (socket says 10.20.193.43:36214) 2026-02-21T01:27:57.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd49a575640 1 -- 10.20.193.43:0/4127093037 learned_addr learned my addr 10.20.193.43:0/4127093037 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296182432 0 0) 0x7f6334056c50 con 0x7f6334057630 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): my global_id is 4257 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6318003610 con 0x7f6334057630 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3140449396 0 0) 0x7f633408f5c0 con 0x7f6334058260 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient(hunting): my global_id is 4241 2026-02-21T01:27:57.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6334056c50 con 0x7f6334058260 2026-02-21T01:27:57.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122874045 0 0) 0x7fd49c088ae0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): my global_id is 4244 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd488003610 con 0x7fd49c08d8d0 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 664388995 0 0) 0x7fd49c08a690 con 0x7fd49c08ddb0 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient(hunting): my global_id is 4260 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c088ae0 con 0x7fd49c08ddb0 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 10 monclient: monmap: 2026-02-21T01:27:57.791 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.792 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient(hunting): picked mon.noname-c con 0x7f16f008de90 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient(hunting): picked mon.noname-b con 0x7f16f013efc0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 10 monclient: shutdown 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 1 -- 10.20.193.43:0/3588551244 >> v1:10.20.193.43:6789/0 conn(0x7fe93c08c330 legacy=0x7fe93c17ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1578306445 0 0) 0x7f6334056c50 con 0x7f6334058260 2026-02-21T01:27:57.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 >> v1:10.20.193.46:6789/0 conn(0x7f6334181e80 legacy=0x7f63341a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:57.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient(hunting): picked mon.noname-a con 0x7f16f013faa0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f012d790 con 0x7f16f013faa0 2026-02-21T01:27:57.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f012da70 con 0x7f16f013efc0 2026-02-21T01:27:57.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 >> v1:10.20.193.43:6789/0 conn(0x7f6334057630 legacy=0x7f633408e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f0057a40 con 0x7f16f008de90 2026-02-21T01:27:57.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f67eb640 10 monclient(hunting): authenticate will time out at 609.443884s 2026-02-21T01:27:57.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3764351776 0 0) 0x7fd488003610 con 0x7fd49c08d8d0 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63340563b0 con 0x7f6334058260 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 >> v1:10.20.193.46:6789/0 conn(0x7fd49c08d4d0 legacy=0x7fd49c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 >> v1:10.20.193.43:6789/0 conn(0x7fd49c08ddb0 legacy=0x7fd49c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6320002df0 con 0x7f6334058260 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: dump: 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.797 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.798 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.798 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.798 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c1a3ef0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 5 monclient: authenticate success, global_id 4241 2026-02-21T01:27:57.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd48c003170 con 0x7fd49c08d8d0 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f4d61640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f16f013faa0 0x7f16f0191600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36228/0 (socket says 10.20.193.43:36228) 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd499573640 10 monclient: dump: 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.799 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16f4d61640 1 -- 10.20.193.43:0/1887344571 learned_addr learned my addr 10.20.193.43:0/1887344571 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16effff640 1 --1- 10.20.193.43:0/1887344571 >> v1:10.20.193.43:6790/0 conn(0x7f16f008de90 0x7f16f012a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53306/0 (socket says 10.20.193.43:53306) 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 5 monclient: authenticate success, global_id 4244 2026-02-21T01:27:57.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fd4a0cae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 1 -- 10.20.193.43:0/3588551244 shutdown_connections 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 1 -- 10.20.193.43:0/3588551244 >> 10.20.193.43:0/3588551244 conn(0x7fe93c091ad0 msgr2=0x7fe93c08dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 1 librados: starting msgr at 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f410a09f640 1 librados: starting objecter 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16ecff9640 10 client.?.objecter ms_handle_connect 0x7f16f013faa0 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16ecff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16ecff9640 10 client.?.objecter ms_handle_connect 0x7f16f008de90 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f16ecff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6320003040 con 0x7f6334058260 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 1 -- 10.20.193.43:0/1489423067 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6320003480 con 0x7f6334058260 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f6339fbb640 4 set_mon_vals no callback set 2026-02-21T01:27:57.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7fe941432640 1 -- 10.20.193.43:0/3588551244 shutdown_connections 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.738+0000 7f63327fc640 10 monclient: dump: 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 1 -- 10.20.193.43:0/3588551244 wait complete. 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd48c0033f0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd499573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd499573640 1 -- 10.20.193.43:0/4127093037 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd48c003830 con 0x7fd49c08d8d0 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd499573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd499573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd499573640 10 monclient: dump: 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 4 set_mon_vals no callback set 2026-02-21T01:27:57.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 Processor -- start 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 639766347 0 0) 0x7f16f012d790 con 0x7f16f013faa0 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): my global_id is 4263 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16c0003610 con 0x7f16f013faa0 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 client.?.objecter ms_handle_connect 0x7f16f013efc0 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850309992 0 0) 0x7f16f0057a40 con 0x7f16f008de90 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): my global_id is 4247 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f012d790 con 0x7f16f008de90 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 -- start start 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 librados: setting wanted keys 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 librados: calling monclient init 2026-02-21T01:27:57.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient: init 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422457427 0 0) 0x7f16f012da70 con 0x7f16f013efc0 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): my global_id is 4219 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f0057a40 con 0x7f16f013efc0 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3963624873 0 0) 0x7f16f012d790 con 0x7f16f008de90 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16f012da70 con 0x7f16f008de90 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2170566509 0 0) 0x7f16c0003610 con 0x7f16f013faa0 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 10 monclient: monmap: 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.739537+0000 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.739537+0000 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.805 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16f012d790 con 0x7f16f013faa0 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f16dc004010 con 0x7f16f008de90 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): dump: 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.806 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f16e40036d0 con 0x7f16f013faa0 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient(hunting): dump: 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2515470297 0 0) 0x7f16f012da70 con 0x7f16f008de90 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 >> v1:10.20.193.46:6789/0 conn(0x7f16f013efc0 legacy=0x7f16f012a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 >> v1:10.20.193.43:6789/0 conn(0x7f16f013faa0 legacy=0x7f16f0191600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 monclient: found mon.c 2026-02-21T01:27:57.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f00574d0 con 0x7f16f008de90 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 5 monclient: authenticate success, global_id 4247 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 monclient: _renew_subs 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16f008a680 con 0x7f16f008de90 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16dc0041b0 con 0x7f16f008de90 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 client.4247.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 monclient: _renew_subs 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f16dc0028f0 con 0x7f16f008de90 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f16f012aef0 con 0x7f16f008de90 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 1 librados: init done 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ee7fc640 4 set_mon_vals no callback set 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 10 monclient: dump: 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.808 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 10 monclient: shutdown 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 10 monclient: shutdown 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 1 -- 10.20.193.43:0/4127093037 >> v1:10.20.193.43:6790/0 conn(0x7fd49c08d8d0 legacy=0x7fd49c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 1 -- 10.20.193.43:0/1489423067 >> v1:10.20.193.43:6790/0 conn(0x7f6334058260 legacy=0x7f633408df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient(hunting): picked mon.noname-b con 0x7f410405d520 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient(hunting): picked mon.noname-a con 0x7f41040870c0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient(hunting): picked mon.noname-c con 0x7f4104087ad0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 1 -- 10.20.193.43:0/1489423067 shutdown_connections 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 1 -- 10.20.193.43:0/1489423067 >> 10.20.193.43:0/1489423067 conn(0x7f6334090360 msgr2=0x7f6334090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41041a9f90 con 0x7f41040870c0 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4104088480 con 0x7f410405d520 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4104058370 con 0x7f4104087ad0 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient(hunting): authenticate will time out at 609.444458s 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 1 -- 10.20.193.43:0/1489423067 shutdown_connections 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 1 -- 10.20.193.43:0/1489423067 wait complete. 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f4102ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f41040870c0 0x7f4104217a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36242/0 (socket says 10.20.193.43:36242) 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f4102ffd640 1 -- 10.20.193.43:0/4155516817 learned_addr learned my addr 10.20.193.43:0/4155516817 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 10 monclient: monmap: 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 1 librados: starting msgr at 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 1 librados: starting objecter 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 1 Processor -- start 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 client.?.objecter ms_handle_connect 0x7f41040870c0 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 client.?.objecter ms_handle_connect 0x7f4104087ad0 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215321084 0 0) 0x7f4104058370 con 0x7f4104087ad0 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): my global_id is 4250 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40d4003610 con 0x7f4104087ad0 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 client.?.objecter ms_handle_connect 0x7f410405d520 2026-02-21T01:27:57.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851853343 0 0) 0x7f41041a9f90 con 0x7f41040870c0 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): my global_id is 4266 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4104058370 con 0x7f41040870c0 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 1 Processor -- start 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 1 -- start start 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 10 monclient: init 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 142209642 0 0) 0x7f40d4003610 con 0x7f4104087ad0 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41041a9f90 con 0x7f4104087ad0 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f40f8003310 con 0x7f4104087ad0 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): dump: 2026-02-21T01:27:57.812 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733874476 0 0) 0x7f41040866e0 con 0x7f410405d520 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): my global_id is 4222 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40d4003610 con 0x7f410405d520 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1999541825 0 0) 0x7f4104058370 con 0x7f41040870c0 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41040866e0 con 0x7f41040870c0 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 1 -- 10.20.193.43:0/4127093037 shutdown_connections 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 1 -- 10.20.193.43:0/4127093037 >> 10.20.193.43:0/4127093037 conn(0x7fd49c08f480 msgr2=0x7fd49c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f40f40030f0 con 0x7f41040870c0 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient(hunting): dump: 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.813 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 1 -- start start 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 1 librados: setting wanted keys 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 1 librados: calling monclient init 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fe941432640 10 monclient: init 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1075714690 0 0) 0x7f41041a9f90 con 0x7f4104087ad0 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 >> v1:10.20.193.46:6789/0 conn(0x7f410405d520 legacy=0x7f41041d6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 >> v1:10.20.193.43:6789/0 conn(0x7f41040870c0 legacy=0x7f4104217a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 monclient: found mon.c 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7fd4a0cae640 1 -- 10.20.193.43:0/4127093037 shutdown_connections 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41041a0a10 con 0x7f4104087ad0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 5 monclient: authenticate success, global_id 4250 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient: _renew_subs 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f410408a670 con 0x7f4104087ad0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 client.4250.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient: _renew_subs 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4104058650 con 0x7f4104087ad0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f410a09f640 1 librados: init done 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f40f80039f0 con 0x7f4104087ad0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f40f8003e00 con 0x7f4104087ad0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f40dffff640 10 monclient: dump: 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.815 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f4101ffb640 4 set_mon_vals no callback set 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 client.4247.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 15 client.4247.objecter _session_command_op_assign -1 1 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 20 client.4247.objecter _get_session osd=-1 returning homeless 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 client.4247.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f16f012b220 con 0x7f16f008de90 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f16dc002b10 con 0x7f16f008de90 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7efe4edf5640 10 monclient(hunting): picked mon.noname-a con 0x7efe48058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 10 monclient(hunting): picked mon.noname-b con 0x7efe48057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 -- 10.20.193.43:0/4127093037 wait complete. 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 10 monclient: monmap: 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient(hunting): picked mon.noname-a con 0x7fe93c05d520 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 1 librados: starting msgr at 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.739+0000 7f6339fbb640 1 librados: starting objecter 2026-02-21T01:27:57.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 1 Processor -- start 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient(hunting): picked mon.noname-c con 0x7fe93c08c330 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 10 monclient(hunting): picked mon.noname-c con 0x7efe48181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient(hunting): picked mon.noname-b con 0x7fe93c08c770 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe48056c50 con 0x7efe48058260 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c1d2cf0 con 0x7fe93c05d520 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c088480 con 0x7fe93c08c770 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93c08a5b0 con 0x7fe93c08c330 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient(hunting): authenticate will time out at 609.445090s 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4cb6a640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7efe48058260 0x7efe4808df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36244/0 (socket says 10.20.193.43:36244) 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4cb6a640 1 -- 10.20.193.43:0/755784547 learned_addr learned my addr 10.20.193.43:0/755784547 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 1 -- 10.20.193.43:0/755784547 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4808eda0 con 0x7efe48181e80 2026-02-21T01:27:57.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 1 -- start start 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 1 librados: setting wanted keys 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 1 librados: calling monclient init 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient: init 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe93affd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fe93c05d520 0x7fe93c1a7f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36252/0 (socket says 10.20.193.43:36252) 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe93affd640 1 -- 10.20.193.43:0/3488262390 learned_addr learned my addr 10.20.193.43:0/3488262390 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 1 -- 10.20.193.43:0/755784547 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4808f5c0 con 0x7efe48057630 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 10 monclient(hunting): authenticate will time out at 609.445130s 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f16dc04dbd0 con 0x7f16f008de90 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 10 client.4247.objecter ms_dispatch2 0x7f16f0000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 3 client.4247.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 3 client.4247.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 client.?.objecter ms_handle_connect 0x7fe93c08c330 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 client.?.objecter ms_handle_connect 0x7fe93c05d520 2026-02-21T01:27:57.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 10 client.4247.objecter checking command 1 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 20 client.4247.objecter _get_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 20 client.4247.objecter put_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 15 client.4247.objecter _session_command_op_remove -1 1 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 20 client.4247.objecter _get_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 20 client.4247.objecter get_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 15 client.4247.objecter _session_command_op_assign 0 1 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 20 client.4247.objecter put_session s=0x7f16c0063050 osd=0 4 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46445795 0 0) 0x7fe93c1d2cf0 con 0x7fe93c05d520 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 10 client.4247.objecter _send_command 1 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6800/1072173340 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16c00853a0 con 0x7f16c0063700 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 20 client.4247.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f16dc04e020 con 0x7f16f008de90 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): my global_id is 4272 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f40f8003fa0 con 0x7f4104087ad0 2026-02-21T01:27:57.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f410a09f640 10 client.4250.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe908003610 con 0x7fe93c05d520 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241085813 0 0) 0x7fe93c08a5b0 con 0x7fe93c08c330 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f410a09f640 15 client.4250.objecter _session_command_op_assign -1 1 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f410a09f640 20 client.4250.objecter _get_session osd=-1 returning homeless 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f410a09f640 10 client.4250.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): my global_id is 4253 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f410a09f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.43:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f41040874e0 con 0x7f4104087ad0 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe93c1d2cf0 con 0x7fe93c08c330 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001281420 0 0) 0x7efe48056c50 con 0x7efe48058260 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): my global_id is 4269 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe34003610 con 0x7efe48058260 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271589137 0 0) 0x7efe4808f5c0 con 0x7efe48057630 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient(hunting): my global_id is 4256 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe48056c50 con 0x7efe48057630 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 client.?.objecter ms_handle_connect 0x7fe93c08c770 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ef7fe640 10 monclient: get_auth_request con 0x7f16c003eaf0 auth_method 0 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2022791801 0 0) 0x7fe908003610 con 0x7fe93c05d520 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe93c08a5b0 con 0x7fe93c05d520 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe930002970 con 0x7fe93c05d520 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): dump: 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 367444467 0 0) 0x7efe34003610 con 0x7efe48058260 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 >> v1:10.20.193.43:6790/0 conn(0x7efe48057630 legacy=0x7efe4808e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient: monmap: 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16f4d61640 10 monclient: get_auth_request con 0x7f16c0063700 auth_method 0 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 >> v1:10.20.193.46:6789/0 conn(0x7efe48181e80 legacy=0x7efe481a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 monclient: found mon.noname-a 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe480563b0 con 0x7efe48058260 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efe38002df0 con 0x7efe48058260 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: dump: 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 5 monclient: authenticate success, global_id 4269 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 870436724 0 0) 0x7fe93c08a5b0 con 0x7fe93c05d520 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient(hunting): picked mon.noname-c con 0x7f6334057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient(hunting): picked mon.noname-b con 0x7f6334058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 >> v1:10.20.193.43:6790/0 conn(0x7fe93c08c330 legacy=0x7fe93c213130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 >> v1:10.20.193.46:6789/0 conn(0x7fe93c08c770 legacy=0x7fe93c234860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient(hunting): picked mon.noname-a con 0x7f6334181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6334149640 con 0x7f6334181e80 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6334130890 con 0x7f6334058260 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633412fa20 con 0x7f6334057630 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 monclient: found mon.a 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c1918e0 con 0x7fe93c05d520 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f6339fbb640 10 monclient(hunting): authenticate will time out at 609.445447s 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 5 monclient: authenticate success, global_id 4272 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient: _renew_subs 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe93c192620 con 0x7fe93c05d520 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f63337fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f6334057630 0x7f6334148f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53334/0 (socket says 10.20.193.43:53334) 2026-02-21T01:27:57.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f63337fe640 1 -- 10.20.193.43:0/1914734278 learned_addr learned my addr 10.20.193.43:0/1914734278 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 librados: starting msgr at 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 librados: starting objecter 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f40f804ce50 con 0x7f4104087ad0 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 10 client.4247.objecter ms_handle_connect 0x7f16c0063700 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 client.4272.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient: _renew_subs 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 10 client.4250.objecter ms_dispatch2 0x7f4104000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe93c1912e0 con 0x7fe93c05d520 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe941432640 1 librados: init done 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 3 client.4250.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe930002b10 con 0x7fe93c05d520 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe930004af0 con 0x7fe93c05d520 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe91b7fe640 10 monclient: dump: 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 3 client.4250.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 Processor -- start 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fe9397fa640 4 set_mon_vals no callback set 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f16ecff9640 10 client.4247.objecter ms_handle_connect 0x7f16c003eaf0 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 client.?.objecter ms_handle_connect 0x7f6334181e80 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 client.?.objecter ms_handle_connect 0x7f6334057630 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 10 client.4250.objecter checking command 1 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 -- start start 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 librados: setting wanted keys 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 librados: calling monclient init 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient: init 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 20 client.4250.objecter _get_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 20 client.4250.objecter put_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 15 client.4250.objecter _session_command_op_remove -1 1 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 20 client.4250.objecter _get_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f41037fe640 10 monclient: get_auth_request con 0x7f40d403ebf0 auth_method 0 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 20 client.4250.objecter get_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 15 client.4250.objecter _session_command_op_assign 5 1 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 20 client.4250.objecter put_session s=0x7f40d40630d0 osd=5 4 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 10 client.4250.objecter _send_command 1 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.46:6800/1266691672 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40d4085400 con 0x7f40d4063780 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 20 client.4250.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f40f8015f10 con 0x7f4104087ad0 2026-02-21T01:27:57.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f40dffff640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe38002fc0 con 0x7efe48058260 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 1 -- 10.20.193.43:0/755784547 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efe38003400 con 0x7efe48058260 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe4edf5640 4 set_mon_vals no callback set 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7efe3f7fe640 10 monclient: dump: 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146555685 0 0) 0x7f633412fa20 con 0x7f6334057630 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 10 monclient(hunting): picked mon.noname-b con 0x7fd49c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7fd4a0cae640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c057250 con 0x7fd49c08d8d0 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c05e1b0 con 0x7fd49c08ddb0 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe941432640 10 client.4272.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe941432640 15 client.4272.objecter _session_command_op_assign -1 1 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd499d74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd49c08d8d0 0x7fd49c11f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36280/0 (socket says 10.20.193.43:36280) 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd499d74640 1 -- 10.20.193.43:0/1325391168 learned_addr learned my addr 10.20.193.43:0/1325391168 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe941432640 20 client.4272.objecter _get_session osd=-1 returning homeless 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe941432640 10 client.4272.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe941432640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe93c1a95a0 con 0x7fe93c05d520 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): my global_id is 4259 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6304003610 con 0x7f6334057630 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910337171 0 0) 0x7f6334149640 con 0x7f6334181e80 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f4102ffd640 10 monclient: get_auth_request con 0x7f40d4063780 auth_method 0 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 client.?.objecter ms_handle_connect 0x7fd49c08d4d0 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 client.?.objecter ms_handle_connect 0x7fd49c08d8d0 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== osd.0 v1:10.20.193.43:6800/1072173340 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f16c00853a0 con 0x7f16c0063700 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c125f10 con 0x7fd49c08d4d0 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 monclient(hunting): authenticate will time out at 609.446104s 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f16ecff9640 10 client.4247.objecter ms_dispatch2 0x7f16f0000b90 command_reply(tid 1: 0 ) 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f16ecff9640 10 client.4247.objecter _finish_command 1 = system:0 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 10 monclient(hunting): my global_id is 4275 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.740+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f633412fa20 con 0x7f6334181e80 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f16ecff9640 20 client.4247.objecter put_session s=0x7f16c0063050 osd=0 4 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f40dffff640 10 client.4250.objecter ms_handle_connect 0x7f40d403ebf0 2026-02-21T01:27:57.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f16ecff9640 15 client.4247.objecter _session_command_op_remove 0 1 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532277966 0 0) 0x7fd49c057250 con 0x7fd49c08d8d0 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): my global_id is 4278 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd468003610 con 0x7fd49c08d8d0 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fe930011470 con 0x7fe93c05d520 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028417702 0 0) 0x7fd49c125f10 con 0x7fd49c08d4d0 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): my global_id is 4262 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c057250 con 0x7fd49c08d4d0 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 client.?.objecter ms_handle_connect 0x7fd49c08ddb0 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 10 monclient: shutdown 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 -- 10.20.193.43:0/755784547 >> v1:10.20.193.43:6789/0 conn(0x7efe48058260 legacy=0x7efe4808df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f40dffff640 10 client.4250.objecter ms_handle_connect 0x7f40d4063780 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 791901683 0 0) 0x7fd468003610 con 0x7fd49c08d8d0 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49c125f10 con 0x7fd49c08d8d0 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd484003190 con 0x7fd49c08d8d0 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): dump: 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 -- 10.20.193.43:0/755784547 shutdown_connections 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 -- 10.20.193.43:0/755784547 >> 10.20.193.43:0/755784547 conn(0x7efe48090360 msgr2=0x7efe48090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 -- 10.20.193.43:0/755784547 shutdown_connections 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3965469707 0 0) 0x7f633412fa20 con 0x7f6334181e80 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6334149640 con 0x7f6334181e80 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6328003040 con 0x7f6334181e80 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2521617307 0 0) 0x7fd49c057250 con 0x7fd49c08d4d0 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd468003610 con 0x7fd49c08d4d0 2026-02-21T01:27:57.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3605230964 0 0) 0x7fd49c125f10 con 0x7fd49c08d8d0 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 >> v1:10.20.193.43:6790/0 conn(0x7fd49c08d4d0 legacy=0x7fd49c11ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 >> v1:10.20.193.46:6789/0 conn(0x7fd49c08ddb0 legacy=0x7fd49c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 monclient: found mon.a 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c128270 con 0x7fd49c08d8d0 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 -- 10.20.193.43:0/755784547 wait complete. 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient(hunting): dump: 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 client.?.objecter ms_handle_connect 0x7f6334058260 2026-02-21T01:27:57.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 237802948 0 0) 0x7f6304003610 con 0x7f6334057630 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f633412fa20 con 0x7f6334057630 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7fe93004dd40 con 0x7fe93c05d520 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 5 monclient: authenticate success, global_id 4278 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 monclient: _renew_subs 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c1279d0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 client.4278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 monclient: _renew_subs 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd49c111c30 con 0x7fd49c08d8d0 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 1 librados: init done 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4840039b0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd484003be0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 10 monclient: dump: 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.835 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3152977312 0 0) 0x7f6334149640 con 0x7f6334181e80 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 >> v1:10.20.193.43:6790/0 conn(0x7f6334057630 legacy=0x7f6334148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 >> v1:10.20.193.46:6789/0 conn(0x7f6334058260 legacy=0x7f63341702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 monclient: found mon.a 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633412e530 con 0x7f6334181e80 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 10 client.4272.objecter ms_dispatch2 0x7fe93c000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 3 client.4272.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 3 client.4272.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 10 client.4272.objecter checking command 1 2026-02-21T01:27:57.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 5 monclient: authenticate success, global_id 4275 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 10 monclient: _renew_subs 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f633412fff0 con 0x7f6334181e80 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 10 client.4275.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 10 monclient: _renew_subs 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f633412f270 con 0x7f6334181e80 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6339fbb640 1 librados: init done 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== osd.5 v1:10.20.193.46:6800/1266691672 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f40d4085400 con 0x7f40d4063780 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 10 monclient: monmap: 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63280036c0 con 0x7f6334181e80 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f63280038b0 con 0x7f6334181e80 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 client.4278.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 15 client.4278.objecter _session_command_op_assign -1 1 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 20 client.4278.objecter _get_session osd=-1 returning homeless 2026-02-21T01:27:57.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 client.4278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f6331ffb640 4 set_mon_vals no callback set 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f630ffff640 10 monclient: dump: 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.43:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd49c08ed90 con 0x7fd49c08d8d0 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f40dffff640 10 client.4250.objecter ms_dispatch2 0x7f4104000b90 command_reply(tid 1: 0 ) 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f40dffff640 10 client.4250.objecter _finish_command 1 = system:0 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f40dffff640 20 client.4250.objecter put_session s=0x7f40d40630d0 osd=5 4 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7f40dffff640 15 client.4250.objecter _session_command_op_remove 5 1 2026-02-21T01:27:57.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 librados: starting msgr at 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 librados: starting objecter 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7efe4edf5640 1 Processor -- start 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 -- start start 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 librados: setting wanted keys 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 librados: calling monclient init 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient: init 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 20 client.4272.objecter _get_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 20 client.4272.objecter put_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 15 client.4272.objecter _session_command_op_remove -1 1 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 20 client.4272.objecter _get_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 20 client.4272.objecter get_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 15 client.4272.objecter _session_command_op_assign 1 1 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 20 client.4272.objecter put_session s=0x7fe9080630d0 osd=1 4 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 10 client.4272.objecter _send_command 1 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6808/3522371706 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe930003550 con 0x7fe908063780 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 20 client.4272.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7fe93004e150 con 0x7fe93c05d520 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe93a7fc640 10 monclient: get_auth_request con 0x7fe90803eb50 auth_method 0 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe93b7fe640 10 monclient: get_auth_request con 0x7fe908063780 auth_method 0 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 10 client.4272.objecter ms_handle_connect 0x7fe908063780 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fe91b7fe640 10 client.4272.objecter ms_handle_connect 0x7fe90803eb50 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== osd.1 v1:10.20.193.43:6808/3522371706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe930003550 con 0x7fe908063780 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f6339fbb640 10 client.4275.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fe91b7fe640 10 client.4272.objecter ms_dispatch2 0x7fe93c000b90 command_reply(tid 1: 0 ) 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f6339fbb640 15 client.4275.objecter _session_command_op_assign -1 1 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fe91b7fe640 10 client.4272.objecter _finish_command 1 = system:0 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fe91b7fe640 20 client.4272.objecter put_session s=0x7fe9080630d0 osd=1 4 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fe91b7fe640 15 client.4272.objecter _session_command_op_remove 1 1 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f6339fbb640 20 client.4275.objecter _get_session osd=-1 returning homeless 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.741+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fd484003d80 con 0x7fd49c08d8d0 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7fd48404dec0 con 0x7fd49c08d8d0 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 10 client.4278.objecter ms_dispatch2 0x7fd49c000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 3 client.4278.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f6339fbb640 10 client.4275.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 3 client.4278.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 10 client.4278.objecter checking command 1 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 20 client.4278.objecter _get_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 20 client.4278.objecter put_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 15 client.4278.objecter _session_command_op_remove -1 1 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 20 client.4278.objecter _get_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f6339fbb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 20 client.4278.objecter get_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 15 client.4278.objecter _session_command_op_assign 3 1 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 20 client.4278.objecter put_session s=0x7fd468063200 osd=3 4 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 10 client.4278.objecter _send_command 1 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.46:6808/3250452844 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd468085550 con 0x7fd4680638b0 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 20 client.4278.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6334092830 con 0x7f6334181e80 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7fd484004480 con 0x7fd49c08d8d0 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd483fff640 4 set_mon_vals no callback set 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd49a575640 10 monclient: get_auth_request con 0x7fd46803ed10 auth_method 0 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient(hunting): picked mon.noname-b con 0x7efe48057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient(hunting): picked mon.noname-a con 0x7efe48058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient(hunting): picked mon.noname-c con 0x7efe48181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f6328010460 con 0x7f6334181e80 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3ffff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7efe48058260 0x7efe48174b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36292/0 (socket says 10.20.193.43:36292) 2026-02-21T01:27:57.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3ffff640 1 -- 10.20.193.43:0/3510602308 learned_addr learned my addr 10.20.193.43:0/3510602308 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4805bd90 con 0x7efe48058260 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4805a290 con 0x7efe48057630 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4808a870 con 0x7efe48181e80 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient(hunting): authenticate will time out at 609.447370s 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 client.?.objecter ms_handle_connect 0x7efe48058260 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd49ad76640 10 monclient: get_auth_request con 0x7fd4680638b0 auth_method 0 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 client.?.objecter ms_handle_connect 0x7efe48181e80 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634243634 0 0) 0x7efe4805bd90 con 0x7efe48058260 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): my global_id is 4281 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe18003610 con 0x7efe48058260 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 10 client.4278.objecter ms_handle_connect 0x7fd46803ed10 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386269040 0 0) 0x7efe4808a870 con 0x7efe48181e80 2026-02-21T01:27:57.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f632804cdd0 con 0x7f6334181e80 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 10 client.4275.objecter ms_dispatch2 0x7f6334000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 3 client.4275.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 3 client.4275.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 10 client.4275.objecter checking command 1 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 20 client.4275.objecter _get_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 20 client.4275.objecter put_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): my global_id is 4265 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 15 client.4275.objecter _session_command_op_remove -1 1 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 20 client.4275.objecter _get_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 20 client.4275.objecter get_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 15 client.4275.objecter _session_command_op_assign 2 1 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 20 client.4275.objecter put_session s=0x7f6304062ff0 osd=2 4 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 10 client.4275.objecter _send_command 1 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6804/3123352217 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63280038b0 con 0x7f63040636a0 2026-02-21T01:27:57.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 20 client.4275.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7fd482ffd640 10 client.4278.objecter ms_handle_connect 0x7fd4680638b0 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f6328011c40 con 0x7f6334181e80 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe4805bd90 con 0x7efe48181e80 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2011478773 0 0) 0x7efe18003610 con 0x7efe48058260 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe4808a870 con 0x7efe48058260 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f6332ffd640 10 monclient: get_auth_request con 0x7f63040636a0 auth_method 0 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efe30003150 con 0x7efe48058260 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): dump: 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.844 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.845 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.845 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:57.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 client.?.objecter ms_handle_connect 0x7efe48057630 2026-02-21T01:27:57.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:57.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7f630ffff640 10 client.4275.objecter ms_handle_connect 0x7f63040636a0 2026-02-21T01:27:57.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1625056219 0 0) 0x7efe4805bd90 con 0x7efe48181e80 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe18003610 con 0x7efe48181e80 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efe44003360 con 0x7efe48181e80 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient(hunting): dump: 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3048212874 0 0) 0x7efe4808a870 con 0x7efe48058260 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 >> v1:10.20.193.43:6790/0 conn(0x7efe48181e80 legacy=0x7efe48176280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 >> v1:10.20.193.46:6789/0 conn(0x7efe48057630 legacy=0x7efe4814d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 monclient: found mon.a 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4805a8a0 con 0x7efe48058260 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 5 monclient: authenticate success, global_id 4281 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient: _renew_subs 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe4805cc00 con 0x7efe48058260 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 client.4281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient: _renew_subs 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efe4805b5e0 con 0x7efe48058260 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe4edf5640 1 librados: init done 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe30003500 con 0x7efe48058260 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efe30003b50 con 0x7efe48058260 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== osd.2 v1:10.20.193.43:6804/3123352217 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f63280038b0 con 0x7f63040636a0 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7f630ffff640 10 client.4275.objecter ms_dispatch2 0x7f6334000b90 command_reply(tid 1: 0 ) 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7f630ffff640 10 client.4275.objecter _finish_command 1 = system:0 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7f630ffff640 20 client.4275.objecter put_session s=0x7f6304062ff0 osd=2 4 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7f630ffff640 15 client.4275.objecter _session_command_op_remove 2 1 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== osd.3 v1:10.20.193.46:6808/3250452844 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd468085550 con 0x7fd4680638b0 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3d7fa640 10 monclient: dump: 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.742+0000 7efe3effd640 4 set_mon_vals no callback set 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7efe30003cf0 con 0x7efe48058260 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe16ffd640 10 client.4281.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe16ffd640 15 client.4281.objecter _session_command_op_assign -1 1 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe16ffd640 20 client.4281.objecter _get_session osd=-1 returning homeless 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe16ffd640 10 client.4281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe16ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:57.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.43:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7efe0c003950 con 0x7efe48058260 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7fd482ffd640 10 client.4278.objecter ms_dispatch2 0x7fd49c000b90 command_reply(tid 1: 0 ) 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7fd482ffd640 10 client.4278.objecter _finish_command 1 = system:0 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7fd482ffd640 20 client.4278.objecter put_session s=0x7fd468063200 osd=3 4 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7fd482ffd640 15 client.4278.objecter _session_command_op_remove 3 1 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7efe3004ddd0 con 0x7efe48058260 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 10 client.4281.objecter ms_dispatch2 0x7efe48000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 3 client.4281.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 3 client.4281.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 10 client.4281.objecter checking command 1 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 20 client.4281.objecter _get_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 20 client.4281.objecter put_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 15 client.4281.objecter _session_command_op_remove -1 1 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 20 client.4281.objecter _get_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 20 client.4281.objecter get_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 15 client.4281.objecter _session_command_op_assign 4 1 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 20 client.4281.objecter put_session s=0x7efe18062d70 osd=4 4 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 10 client.4281.objecter _send_command 1 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.46:6802/3807500891 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe180850c0 con 0x7efe18063420 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 20 client.4281.objecter dump_active .. 0 homeless 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7efe3004f160 con 0x7efe48058260 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe4d36b640 10 monclient: get_auth_request con 0x7efe18063420 auth_method 0 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.743+0000 7efe3d7fa640 10 client.4281.objecter ms_handle_connect 0x7efe18063420 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.744+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== osd.4 v1:10.20.193.46:6802/3807500891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7efe180850c0 con 0x7efe18063420 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.744+0000 7efe3d7fa640 10 client.4281.objecter ms_dispatch2 0x7efe48000b90 command_reply(tid 1: 0 ) 2026-02-21T01:27:57.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.744+0000 7efe3d7fa640 10 client.4281.objecter _finish_command 1 = system:0 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.744+0000 7efe3d7fa640 20 client.4281.objecter put_session s=0x7efe18062d70 osd=4 4 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.744+0000 7efe3d7fa640 15 client.4281.objecter _session_command_op_remove 4 1 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 10 client.4247.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 15 client.4247.objecter _session_command_op_assign -1 2 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 20 client.4247.objecter _get_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 20 client.4247.objecter put_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 20 client.4247.objecter _get_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 15 client.4247.objecter _session_command_op_remove -1 2 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 20 client.4247.objecter get_session s=0x7f16c0063050 osd=0 3 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 15 client.4247.objecter _session_command_op_assign 0 2 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 20 client.4247.objecter put_session s=0x7f16c0063050 osd=0 4 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 10 client.4247.objecter _send_command 2 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.748+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 --> v1:10.20.193.43:6800/1072173340 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f16f00566a0 con 0x7f16c0063700 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16ecff9640 1 -- 10.20.193.43:0/1887344571 <== osd.0 v1:10.20.193.43:6800/1072173340 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f16f00566a0 con 0x7f16c0063700 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16ecff9640 10 client.4247.objecter ms_dispatch2 0x7f16f0000b90 command_reply(tid 2: 0 ) 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16ecff9640 10 client.4247.objecter _finish_command 2 = system:0 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16ecff9640 20 client.4247.objecter put_session s=0x7f16c0063050 osd=0 4 2026-02-21T01:27:57.849 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16ecff9640 15 client.4247.objecter _session_command_op_remove 0 2 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 10 librados: watch_flush enter 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 10 librados: watch_flush exit 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 10 client.4247.objecter close_session for osd.0 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 >> v1:10.20.193.43:6800/1072173340 conn(0x7f16c0063700 legacy=0x7f16c0083b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 20 client.4247.objecter put_session s=0x7f16c0063050 osd=0 1 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 20 client.4247.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 10 client.4247.objecter successfully canceled tick 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 >> v1:10.20.193.46:6812/860801619 conn(0x7f16c003eaf0 legacy=0x7f16c005efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 10 monclient: shutdown 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 >> v1:10.20.193.43:6790/0 conn(0x7f16f008de90 legacy=0x7f16f012a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 10 client.4250.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 15 client.4250.objecter _session_command_op_assign -1 2 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 20 client.4250.objecter _get_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 20 client.4250.objecter put_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 20 client.4250.objecter _get_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f4d61640 1 -- 10.20.193.43:0/1887344571 reap_dead start 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 15 client.4250.objecter _session_command_op_remove -1 2 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 20 client.4250.objecter get_session s=0x7f40d40630d0 osd=5 3 2026-02-21T01:27:57.850 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 15 client.4250.objecter _session_command_op_assign 5 2 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 20 client.4250.objecter put_session s=0x7f40d40630d0 osd=5 4 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 10 client.4250.objecter _send_command 2 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 --> v1:10.20.193.46:6800/1266691672 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41041a95f0 con 0x7f40d4063780 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 shutdown_connections 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 >> 10.20.193.43:0/1887344571 conn(0x7f16f0093d40 msgr2=0x7f16f0055f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 shutdown_connections 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 -- 10.20.193.43:0/1887344571 wait complete. 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f16f67eb640 1 librados: shutdown 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f40dffff640 1 -- 10.20.193.43:0/4155516817 <== osd.5 v1:10.20.193.46:6800/1266691672 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7f41041a95f0 con 0x7f40d4063780 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f40dffff640 10 client.4250.objecter ms_dispatch2 0x7f4104000b90 command_reply(tid 2: 0 ) 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f40dffff640 10 client.4250.objecter _finish_command 2 = system:0 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f40dffff640 20 client.4250.objecter put_session s=0x7f40d40630d0 osd=5 4 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f40dffff640 15 client.4250.objecter _session_command_op_remove 5 2 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 10 librados: watch_flush enter 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 10 librados: watch_flush exit 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 10 client.4250.objecter close_session for osd.5 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 >> v1:10.20.193.46:6800/1266691672 conn(0x7f40d4063780 legacy=0x7f40d4083b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.851 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.749+0000 7f410a09f640 20 client.4250.objecter put_session s=0x7f40d40630d0 osd=5 1 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 20 client.4250.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 10 client.4250.objecter successfully canceled tick 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 10 client.4272.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 15 client.4272.objecter _session_command_op_assign -1 2 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 client.4272.objecter _get_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 client.4272.objecter put_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 client.4272.objecter _get_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 15 client.4272.objecter _session_command_op_remove -1 2 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 client.4272.objecter get_session s=0x7fe9080630d0 osd=1 3 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 15 client.4272.objecter _session_command_op_assign 1 2 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 >> v1:10.20.193.46:6812/860801619 conn(0x7f40d403ebf0 legacy=0x7f40d405f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 10 monclient: shutdown 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 >> v1:10.20.193.43:6790/0 conn(0x7f4104087ad0 legacy=0x7f4104239140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 client.4272.objecter put_session s=0x7fe9080630d0 osd=1 4 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 10 client.4272.objecter _send_command 2 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 --> v1:10.20.193.43:6808/3522371706 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe93c1d2290 con 0x7fe908063780 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f4103fff640 1 -- 10.20.193.43:0/4155516817 reap_dead start 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 shutdown_connections 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 >> 10.20.193.43:0/4155516817 conn(0x7f4104091aa0 msgr2=0x7f4104088690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 shutdown_connections 2026-02-21T01:27:57.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 1 -- 10.20.193.43:0/4155516817 wait complete. 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe91b7fe640 1 -- 10.20.193.43:0/3488262390 <== osd.1 v1:10.20.193.43:6808/3522371706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fe93c1d2290 con 0x7fe908063780 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe91b7fe640 10 client.4272.objecter ms_dispatch2 0x7fe93c000b90 command_reply(tid 2: 0 ) 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe91b7fe640 10 client.4272.objecter _finish_command 2 = system:0 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe91b7fe640 20 client.4272.objecter put_session s=0x7fe9080630d0 osd=1 4 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe91b7fe640 15 client.4272.objecter _session_command_op_remove 1 2 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7f410a09f640 1 librados: shutdown 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 10 librados: watch_flush enter 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 10 librados: watch_flush exit 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 10 client.4272.objecter close_session for osd.1 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 >> v1:10.20.193.43:6808/3522371706 conn(0x7fe908063780 legacy=0x7fe908083bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 client.4272.objecter put_session s=0x7fe9080630d0 osd=1 1 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 client.4272.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 10 client.4272.objecter successfully canceled tick 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 >> v1:10.20.193.46:6812/860801619 conn(0x7fe90803eb50 legacy=0x7fe90805f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 10 monclient: shutdown 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 >> v1:10.20.193.43:6789/0 conn(0x7fe93c05d520 legacy=0x7fe93c1a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.750+0000 7fe93b7fe640 1 -- 10.20.193.43:0/3488262390 reap_dead start 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 shutdown_connections 2026-02-21T01:27:57.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 >> 10.20.193.43:0/3488262390 conn(0x7fe93c091ad0 msgr2=0x7fe93c1a8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 10 client.4278.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 15 client.4278.objecter _session_command_op_assign -1 2 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 client.4278.objecter _get_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 client.4278.objecter put_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 client.4278.objecter _get_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 15 client.4278.objecter _session_command_op_remove -1 2 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 client.4278.objecter get_session s=0x7fd468063200 osd=3 3 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 15 client.4278.objecter _session_command_op_assign 3 2 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 client.4278.objecter put_session s=0x7fd468063200 osd=3 4 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 10 client.4278.objecter _send_command 2 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 --> v1:10.20.193.46:6808/3250452844 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd49c1a1320 con 0x7fd4680638b0 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 shutdown_connections 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fe941432640 1 -- 10.20.193.43:0/3488262390 wait complete. 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fe941432640 1 librados: shutdown 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 10 client.4275.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 15 client.4275.objecter _session_command_op_assign -1 2 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd482ffd640 1 -- 10.20.193.43:0/1325391168 <== osd.3 v1:10.20.193.46:6808/3250452844 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fd49c1a1320 con 0x7fd4680638b0 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd482ffd640 10 client.4278.objecter ms_dispatch2 0x7fd49c000b90 command_reply(tid 2: 0 ) 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd482ffd640 10 client.4278.objecter _finish_command 2 = system:0 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd482ffd640 20 client.4278.objecter put_session s=0x7fd468063200 osd=3 4 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd482ffd640 15 client.4278.objecter _session_command_op_remove 3 2 2026-02-21T01:27:57.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 20 client.4275.objecter _get_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 20 client.4275.objecter put_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 20 client.4275.objecter _get_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 15 client.4275.objecter _session_command_op_remove -1 2 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 20 client.4275.objecter get_session s=0x7f6304062ff0 osd=2 3 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 15 client.4275.objecter _session_command_op_assign 2 2 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 20 client.4275.objecter put_session s=0x7f6304062ff0 osd=2 4 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 10 client.4275.objecter _send_command 2 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 --> v1:10.20.193.43:6804/3123352217 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f633412dfc0 con 0x7f63040636a0 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 10 librados: watch_flush enter 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 10 librados: watch_flush exit 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 10 client.4278.objecter close_session for osd.3 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 >> v1:10.20.193.46:6808/3250452844 conn(0x7fd4680638b0 legacy=0x7fd468083ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 client.4278.objecter put_session s=0x7fd468063200 osd=3 1 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 client.4278.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 10 client.4278.objecter successfully canceled tick 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 >> v1:10.20.193.46:6812/860801619 conn(0x7fd46803ed10 legacy=0x7fd46805f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 10 monclient: shutdown 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 >> v1:10.20.193.43:6789/0 conn(0x7fd49c08d8d0 legacy=0x7fd49c11f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd49ad76640 1 -- 10.20.193.43:0/1325391168 reap_dead start 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 shutdown_connections 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 >> 10.20.193.43:0/1325391168 conn(0x7fd49c08f480 msgr2=0x7fd49c086560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 shutdown_connections 2026-02-21T01:27:57.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7fd4a0cae640 1 -- 10.20.193.43:0/1325391168 wait complete. 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f630ffff640 1 -- 10.20.193.43:0/1914734278 <== osd.2 v1:10.20.193.43:6804/3123352217 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f633412dfc0 con 0x7f63040636a0 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f630ffff640 10 client.4275.objecter ms_dispatch2 0x7f6334000b90 command_reply(tid 2: 0 ) 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f630ffff640 10 client.4275.objecter _finish_command 2 = system:0 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f630ffff640 20 client.4275.objecter put_session s=0x7f6304062ff0 osd=2 4 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.751+0000 7f630ffff640 15 client.4275.objecter _session_command_op_remove 2 2 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7fd4a0cae640 1 librados: shutdown 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 10 librados: watch_flush enter 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 10 librados: watch_flush exit 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 10 client.4275.objecter close_session for osd.2 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 >> v1:10.20.193.43:6804/3123352217 conn(0x7f63040636a0 legacy=0x7f6304083ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 20 client.4275.objecter put_session s=0x7f6304062ff0 osd=2 1 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 20 client.4275.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 10 client.4275.objecter successfully canceled tick 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 >> v1:10.20.193.46:6812/860801619 conn(0x7f630403eac0 legacy=0x7f630405ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 10 monclient: shutdown 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 >> v1:10.20.193.43:6789/0 conn(0x7f6334181e80 legacy=0x7f6334171a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6333fff640 1 -- 10.20.193.43:0/1914734278 reap_dead start 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 shutdown_connections 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 >> 10.20.193.43:0/1914734278 conn(0x7f6334090360 msgr2=0x7f6334085de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 shutdown_connections 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 -- 10.20.193.43:0/1914734278 wait complete. 2026-02-21T01:27:57.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.752+0000 7f6339fbb640 1 librados: shutdown 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 10 client.4281.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 15 client.4281.objecter _session_command_op_assign -1 2 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 20 client.4281.objecter _get_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 20 client.4281.objecter put_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 20 client.4281.objecter _get_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 15 client.4281.objecter _session_command_op_remove -1 2 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 20 client.4281.objecter get_session s=0x7efe18062d70 osd=4 3 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 15 client.4281.objecter _session_command_op_assign 4 2 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 20 client.4281.objecter put_session s=0x7efe18062d70 osd=4 4 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 10 client.4281.objecter _send_command 2 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.754+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 --> v1:10.20.193.46:6802/3807500891 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe0c002980 con 0x7efe18063420 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe4cb6a640 10 monclient: get_auth_request con 0x7efe1803e890 auth_method 0 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe3d7fa640 1 -- 10.20.193.43:0/3510602308 <== osd.4 v1:10.20.193.46:6802/3807500891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7efe0c002980 con 0x7efe18063420 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe3d7fa640 10 client.4281.objecter ms_dispatch2 0x7efe48000b90 command_reply(tid 2: 0 ) 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe3d7fa640 10 client.4281.objecter _finish_command 2 = system:0 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe3d7fa640 20 client.4281.objecter put_session s=0x7efe18062d70 osd=4 4 2026-02-21T01:27:57.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe3d7fa640 15 client.4281.objecter _session_command_op_remove 4 2 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe3d7fa640 10 client.4281.objecter ms_handle_connect 0x7efe1803e890 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 10 librados: watch_flush enter 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 10 librados: watch_flush exit 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 10 client.4281.objecter close_session for osd.4 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 >> v1:10.20.193.46:6802/3807500891 conn(0x7efe18063420 legacy=0x7efe18083850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 20 client.4281.objecter put_session s=0x7efe18062d70 osd=4 1 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 20 client.4281.objecter shutdown clearing up homeless session... 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 10 client.4281.objecter successfully canceled tick 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 >> v1:10.20.193.46:6812/860801619 conn(0x7efe1803e890 legacy=0x7efe1805ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 10 monclient: shutdown 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 >> v1:10.20.193.43:6789/0 conn(0x7efe48058260 legacy=0x7efe48174b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe4d36b640 1 -- 10.20.193.43:0/3510602308 reap_dead start 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 shutdown_connections 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 >> 10.20.193.43:0/3510602308 conn(0x7efe48090360 msgr2=0x7efe4808aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 shutdown_connections 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 -- 10.20.193.43:0/3510602308 wait complete. 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.755+0000 7efe16ffd640 1 librados: shutdown 2026-02-21T01:27:57.858 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:57.858 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-21T01:27:57.859 INFO:teuthology.orchestra.run.trial043.stdout:47244640260 2026-02-21T01:27:57.859 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-21T01:27:57.859 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:57.859 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-21T01:27:57.860 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:57.860 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-21T01:27:57.860 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:57.860 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-21T01:27:57.860 INFO:teuthology.orchestra.run.trial043.stdout:47244640260 2026-02-21T01:27:57.860 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-21T01:27:57.968 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.968 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient: monmap: 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.967478+0000 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.967478+0000 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 10 monclient: monmap: 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.969 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.967538+0000 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.967538+0000 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 1 Processor -- start 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 1 -- start start 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient: init 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7f7cff7cf640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7f7cff7cf640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 1 Processor -- start 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7f7cff7cf640 10 monclient: monmap: 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.967977+0000 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.967977+0000 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 1 -- start start 2026-02-21T01:27:57.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 10 monclient: init 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient(hunting): picked mon.noname-b con 0x7fed84058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient(hunting): picked mon.noname-c con 0x7fed84057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient(hunting): picked mon.noname-a con 0x7fed84181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed84056c50 con 0x7fed84181e80 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8408eda0 con 0x7fed84057630 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8408f5c0 con 0x7fed84058260 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7fed8b1e0640 10 monclient(hunting): authenticate will time out at 609.672955s 2026-02-21T01:27:57.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.967+0000 7ff304109640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:57.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 10 monclient(hunting): picked mon.noname-b con 0x7ff2fc058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 10 monclient(hunting): picked mon.noname-c con 0x7ff2fc057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 1 Processor -- start 2026-02-21T01:27:57.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 10 monclient(hunting): picked mon.noname-a con 0x7ff2fc181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc056c50 con 0x7ff2fc181e80 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed88f55640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fed84058260 0x7fed8408df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53358/0 (socket says 10.20.193.43:53358) 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed89756640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fed84181e80 0x7fed841a2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36300/0 (socket says 10.20.193.43:36300) 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed88f55640 1 -- 10.20.193.43:0/4287321248 learned_addr learned my addr 10.20.193.43:0/4287321248 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc08eda0 con 0x7ff2fc057630 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc08f5c0 con 0x7ff2fc058260 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 10 monclient(hunting): authenticate will time out at 609.673089s 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 1 -- start start 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient: init 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff301e7e640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff2fc058260 0x7ff2fc08df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53370/0 (socket says 10.20.193.43:53370) 2026-02-21T01:27:57.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff301e7e640 1 -- 10.20.193.43:0/4216113779 learned_addr learned my addr 10.20.193.43:0/4216113779 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240622855 0 0) 0x7fed8408f5c0 con 0x7fed84058260 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851948197 0 0) 0x7ff2fc08f5c0 con 0x7ff2fc058260 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): my global_id is 4268 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed70003610 con 0x7fed84058260 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191497425 0 0) 0x7fed84056c50 con 0x7fed84181e80 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): my global_id is 4284 2026-02-21T01:27:57.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed8408f5c0 con 0x7fed84181e80 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f60998e1640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f60998e1640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f60998e1640 10 monclient: monmap: 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.968625+0000 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.968625+0000 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): my global_id is 4271 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2e4003610 con 0x7ff2fc058260 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246380917 0 0) 0x7ff2fc056c50 con 0x7ff2fc181e80 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient(hunting): my global_id is 4287 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2fc08f5c0 con 0x7ff2fc181e80 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362775135 0 0) 0x7fed8408eda0 con 0x7fed84057630 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient(hunting): my global_id is 4240 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed84056c50 con 0x7fed84057630 2026-02-21T01:27:57.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2610791279 0 0) 0x7fed70003610 con 0x7fed84058260 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 >> v1:10.20.193.46:6789/0 conn(0x7fed84057630 legacy=0x7fed8408e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 >> v1:10.20.193.43:6789/0 conn(0x7fed84181e80 legacy=0x7fed841a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient(hunting): picked mon.noname-b con 0x7f7cf805d520 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient(hunting): picked mon.noname-a con 0x7f7cf808c330 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient(hunting): picked mon.noname-c con 0x7f7cf808c770 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2755040521 0 0) 0x7ff2e4003610 con 0x7ff2fc058260 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 >> v1:10.20.193.46:6789/0 conn(0x7ff2fc057630 legacy=0x7ff2fc08e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 >> v1:10.20.193.43:6789/0 conn(0x7ff2fc181e80 legacy=0x7ff2fc1a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc0563b0 con 0x7ff2fc058260 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2ec002df0 con 0x7ff2fc058260 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 5 monclient: authenticate success, global_id 4271 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed840563b0 con 0x7fed84058260 2026-02-21T01:27:57.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf80863a0 con 0x7f7cf808c330 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf808d190 con 0x7f7cf808c770 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf8090e80 con 0x7f7cf805d520 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: dump: 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed8b1e0640 5 monclient: authenticate success, global_id 4268 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fed74002df0 con 0x7fed84058260 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed8b1e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient(hunting): authenticate will time out at 609.673520s 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: dump: 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.981 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed8b1e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cfd544640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f7cf805d520 0x7f7cf808bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53382/0 (socket says 10.20.193.43:53382) 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cfcd43640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f7cf808c330 0x7f7cf817ea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36324/0 (socket says 10.20.193.43:36324) 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cfd544640 1 -- 10.20.193.43:0/3893538879 learned_addr learned my addr 10.20.193.43:0/3893538879 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fed74002fc0 con 0x7fed84058260 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2ec003000 con 0x7ff2fc058260 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 1 -- 10.20.193.43:0/4216113779 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2ec003440 con 0x7ff2fc058260 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff300e7c640 10 monclient: dump: 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 4 set_mon_vals no callback set 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 1 -- 10.20.193.43:0/4287321248 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fed740033c0 con 0x7fed84058260 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed7b7fe640 10 monclient: dump: 2026-02-21T01:27:57.983 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed8b1e0640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7fed8b1e0640 4 set_mon_vals no callback set 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655704147 0 0) 0x7f7cf8090e80 con 0x7f7cf805d520 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): my global_id is 4274 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce0003610 con 0x7f7cf805d520 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355922553 0 0) 0x7f7cf80863a0 con 0x7f7cf808c330 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient(hunting): my global_id is 4290 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf8090e80 con 0x7f7cf808c330 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f60998e1640 1 Processor -- start 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2538038906 0 0) 0x7f7ce0003610 con 0x7f7cf805d520 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 >> v1:10.20.193.46:6789/0 conn(0x7f7cf808c770 legacy=0x7f7cf81a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 >> v1:10.20.193.43:6789/0 conn(0x7f7cf808c330 legacy=0x7f7cf817ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 10 monclient: shutdown 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- 10.20.193.43:0/4216113779 >> v1:10.20.193.43:6790/0 conn(0x7ff2fc058260 legacy=0x7ff2fc08df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7aa12c9640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7aa12c9640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7aa12c9640 10 monclient: monmap: 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.969147+0000 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.969147+0000 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.986 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf805d8f0 con 0x7f7cf805d520 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ce8002df0 con 0x7f7cf805d520 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f60998e1640 1 -- start start 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f60998e1640 10 monclient: init 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: dump: 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.987 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 5 monclient: authenticate success, global_id 4274 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- 10.20.193.43:0/4216113779 shutdown_connections 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- 10.20.193.43:0/4216113779 >> 10.20.193.43:0/4216113779 conn(0x7ff2fc090360 msgr2=0x7ff2fc090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ce8003070 con 0x7f7cf805d520 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.988 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 1 -- 10.20.193.43:0/3893538879 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ce80034b0 con 0x7f7cf805d520 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7ce7fff640 10 monclient: dump: 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- 10.20.193.43:0/4216113779 shutdown_connections 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7ff304109640 1 -- 10.20.193.43:0/4216113779 wait complete. 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:57.989 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.968+0000 7f7cff7cf640 4 set_mon_vals no callback set 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 10 monclient: shutdown 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4287321248 >> v1:10.20.193.43:6790/0 conn(0x7fed84058260 legacy=0x7fed8408df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4287321248 shutdown_connections 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4287321248 >> 10.20.193.43:0/4287321248 conn(0x7fed84090360 msgr2=0x7fed84090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4287321248 shutdown_connections 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:57.990 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4287321248 wait complete. 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f9c74713640 10 monclient: get_monmap_and_config 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f9c74713640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient(hunting): picked mon.noname-b con 0x7f6094058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f9c74713640 10 monclient: monmap: 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:57.969481+0000 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:57.969481+0000 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.991 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient(hunting): picked mon.noname-a con 0x7f6094057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient(hunting): picked mon.noname-c con 0x7f6094181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6094056c50 con 0x7f6094057630 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 10 monclient: shutdown 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:57.992 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609408eda0 con 0x7f6094181e80 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 1 -- 10.20.193.43:0/3893538879 >> v1:10.20.193.43:6790/0 conn(0x7f7cf805d520 legacy=0x7f7cf808bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609408f5c0 con 0x7f6094058260 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient(hunting): authenticate will time out at 609.674198s 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60927fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6094057630 0x7f609408e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36326/0 (socket says 10.20.193.43:36326) 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60927fc640 1 -- 10.20.193.43:0/2004984531 learned_addr learned my addr 10.20.193.43:0/2004984531 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6092ffd640 1 --1- 10.20.193.43:0/2004984531 >> v1:10.20.193.43:6790/0 conn(0x7f6094058260 0x7f609408df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53390/0 (socket says 10.20.193.43:53390) 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 1 -- 10.20.193.43:0/3893538879 shutdown_connections 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 1 -- 10.20.193.43:0/3893538879 >> 10.20.193.43:0/3893538879 conn(0x7f7cf8091ad0 msgr2=0x7f7cf808dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient: build_initial_monmap 2026-02-21T01:27:57.993 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient: monmap: 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 1 -- 10.20.193.43:0/3893538879 shutdown_connections 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 1 Processor -- start 2026-02-21T01:27:57.994 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 1 -- 10.20.193.43:0/3893538879 wait complete. 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 librados: starting msgr at 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 librados: starting objecter 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 1 -- start start 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient: init 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303901219 0 0) 0x7f609408f5c0 con 0x7f6094058260 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): my global_id is 4277 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6080003610 con 0x7f6094058260 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936076670 0 0) 0x7f6094056c50 con 0x7f6094057630 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.995 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): my global_id is 4293 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609408f5c0 con 0x7f6094057630 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 Processor -- start 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 -- start start 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 librados: setting wanted keys 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 librados: calling monclient init 2026-02-21T01:27:57.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient: init 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537876235 0 0) 0x7f609408eda0 con 0x7f6094181e80 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient(hunting): my global_id is 4246 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6094056c50 con 0x7f6094181e80 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1806628517 0 0) 0x7f6080003610 con 0x7f6094058260 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 >> v1:10.20.193.46:6789/0 conn(0x7f6094181e80 legacy=0x7f60941a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 >> v1:10.20.193.43:6789/0 conn(0x7f6094057630 legacy=0x7f609408e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 monclient: found mon.noname-b 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60940563b0 con 0x7f6094058260 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6088002d20 con 0x7f6094058260 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 5 monclient: authenticate success, global_id 4277 2026-02-21T01:27:57.997 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: dump: 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:57.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f9c74713640 1 Processor -- start 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6088002f70 con 0x7f6094058260 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 1 -- 10.20.193.43:0/2004984531 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f60880033b0 con 0x7f6094058260 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f6091ffb640 10 monclient: dump: 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:57.999 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 4 set_mon_vals no callback set 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f9c74713640 1 -- start start 2026-02-21T01:27:58.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f9c74713640 10 monclient: init 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 10 monclient: build_initial_monmap 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 10 monclient: monmap: 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.001 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:58.002 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:58.002 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:58.002 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:58.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient(hunting): picked mon.noname-b con 0x7ff2fc057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient(hunting): picked mon.noname-a con 0x7ff2fc058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:58.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient(hunting): picked mon.noname-c con 0x7ff2fc181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc149800 con 0x7ff2fc058260 2026-02-21T01:27:58.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient(hunting): picked mon.noname-b con 0x7f7a9c0901a0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc08a870 con 0x7ff2fc057630 2026-02-21T01:27:58.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc12fbe0 con 0x7ff2fc181e80 2026-02-21T01:27:58.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff304109640 10 monclient(hunting): authenticate will time out at 609.674747s 2026-02-21T01:27:58.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient(hunting): picked mon.noname-c con 0x7f7a9c090e20 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient(hunting): picked mon.noname-a con 0x7f7a9c057400 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c090570 con 0x7f7a9c057400 2026-02-21T01:27:58.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 10 monclient: build_initial_monmap 2026-02-21T01:27:58.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c0882a0 con 0x7f7a9c090e20 2026-02-21T01:27:58.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c08c9b0 con 0x7f7a9c0901a0 2026-02-21T01:27:58.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 10 monclient: monmap: 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:58.006 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.007 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7aa12c9640 10 monclient(hunting): authenticate will time out at 609.674817s 2026-02-21T01:27:58.007 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a9affd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f7a9c0901a0 0x7f7a9c08bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53418/0 (socket says 10.20.193.43:53418) 2026-02-21T01:27:58.007 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a9affd640 1 -- 10.20.193.43:0/3205759506 learned_addr learned my addr 10.20.193.43:0/3205759506 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.007 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff30167d640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff2fc058260 0x7ff2fc1704a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36334/0 (socket says 10.20.193.43:36334) 2026-02-21T01:27:58.007 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff30167d640 1 -- 10.20.193.43:0/2416774133 learned_addr learned my addr 10.20.193.43:0/2416774133 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 client.?.objecter ms_handle_connect 0x7ff2fc058260 2026-02-21T01:27:58.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 client.?.objecter ms_handle_connect 0x7ff2fc181e80 2026-02-21T01:27:58.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 librados: starting msgr at 2026-02-21T01:27:58.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 librados: starting objecter 2026-02-21T01:27:58.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 10 monclient: shutdown 2026-02-21T01:27:58.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 1 -- 10.20.193.43:0/2004984531 >> v1:10.20.193.43:6790/0 conn(0x7f6094058260 legacy=0x7f609408df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109779017 0 0) 0x7ff2fc149800 con 0x7ff2fc058260 2026-02-21T01:27:58.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): my global_id is 4296 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2cc003610 con 0x7ff2fc058260 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160767431 0 0) 0x7ff2fc12fbe0 con 0x7ff2fc181e80 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 monclient(hunting): my global_id is 4280 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2fc149800 con 0x7ff2fc181e80 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 client.?.objecter ms_handle_connect 0x7ff2fc057630 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7ff2ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 1 -- 10.20.193.43:0/2004984531 shutdown_connections 2026-02-21T01:27:58.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 1 -- 10.20.193.43:0/2004984531 >> 10.20.193.43:0/2004984531 conn(0x7f6094090360 msgr2=0x7f6094090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156622122 0 0) 0x7f7a9c090570 con 0x7f7a9c057400 2026-02-21T01:27:58.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a99ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a99ffb640 10 monclient(hunting): my global_id is 4299 2026-02-21T01:27:58.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7fed8b1e0640 1 Processor -- start 2026-02-21T01:27:58.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 1 librados: starting msgr at 2026-02-21T01:27:58.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7cff7cf640 1 librados: starting objecter 2026-02-21T01:27:58.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a88003610 con 0x7f7a9c057400 2026-02-21T01:27:58.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.969+0000 7f60998e1640 1 -- 10.20.193.43:0/2004984531 shutdown_connections 2026-02-21T01:27:58.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471711329 0 0) 0x7f7a9c08c9b0 con 0x7f7a9c0901a0 2026-02-21T01:27:58.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient(hunting): my global_id is 4283 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c090570 con 0x7f7a9c0901a0 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 1 Processor -- start 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 1 -- start start 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 1 librados: setting wanted keys 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 1 librados: calling monclient init 2026-02-21T01:27:58.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient: init 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326535075 0 0) 0x7ff2fc08a870 con 0x7ff2fc057630 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): my global_id is 4249 2026-02-21T01:27:58.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient(hunting): picked mon.noname-c con 0x7f9c6c090130 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2fc12fbe0 con 0x7ff2fc057630 2026-02-21T01:27:58.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1696862107 0 0) 0x7ff2fc149800 con 0x7ff2fc181e80 2026-02-21T01:27:58.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient(hunting): picked mon.noname-a con 0x7f9c6c08c0c0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2fc08a870 con 0x7ff2fc181e80 2026-02-21T01:27:58.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2f8003360 con 0x7ff2fc181e80 2026-02-21T01:27:58.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): dump: 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3704308458 0 0) 0x7ff2cc003610 con 0x7ff2fc058260 2026-02-21T01:27:58.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2fc149800 con 0x7ff2fc058260 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient(hunting): picked mon.noname-b con 0x7f9c6c088050 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2f0004020 con 0x7ff2fc058260 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): dump: 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.017 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 1 -- start start 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 1 librados: setting wanted keys 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 1 librados: calling monclient init 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient: init 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6c090500 con 0x7f9c6c08c0c0 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6c0908d0 con 0x7f9c6c090130 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6c058bc0 con 0x7f9c6c088050 2026-02-21T01:27:58.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3302036603 0 0) 0x7f7a88003610 con 0x7f7a9c057400 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 >> v1:10.20.193.43:6790/0 conn(0x7f7a9c0901a0 legacy=0x7f7a9c08bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 >> v1:10.20.193.46:6789/0 conn(0x7f7a9c090e20 legacy=0x7f7a9c08c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 monclient: found mon.noname-a 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient(hunting): authenticate will time out at 609.675198s 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71c87640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f9c6c08c0c0 0x7f9c6c180310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36350/0 (socket says 10.20.193.43:36350) 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71c87640 1 -- 10.20.193.43:0/2583332162 learned_addr learned my addr 10.20.193.43:0/2583332162 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c056fe0 con 0x7f7a9c057400 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a8c0030a0 con 0x7f7a9c057400 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: dump: 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 5 monclient: authenticate success, global_id 4299 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3516453504 0 0) 0x7ff2fc12fbe0 con 0x7ff2fc057630 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2cc003610 con 0x7ff2fc057630 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2ec003350 con 0x7ff2fc057630 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient(hunting): dump: 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.020 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2289110692 0 0) 0x7ff2fc149800 con 0x7ff2fc058260 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 >> v1:10.20.193.43:6790/0 conn(0x7ff2fc181e80 legacy=0x7ff2fc171bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 1 -- 10.20.193.43:0/2004984531 wait complete. 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 >> v1:10.20.193.46:6789/0 conn(0x7ff2fc057630 legacy=0x7ff2fc1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 monclient: found mon.a 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc12e6f0 con 0x7ff2fc058260 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 5 monclient: authenticate success, global_id 4296 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 10 monclient: _renew_subs 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc130a50 con 0x7ff2fc058260 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a8c0032b0 con 0x7f7a9c057400 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 1 -- 10.20.193.43:0/3205759506 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a8c0036f0 con 0x7f7a9c057400 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7a99ffb640 10 monclient: dump: 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 4 set_mon_vals no callback set 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 10 monclient: _renew_subs 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff2fc12f430 con 0x7ff2fc058260 2026-02-21T01:27:58.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 1 librados: init done 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient(hunting): picked mon.noname-b con 0x7fed84057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient(hunting): picked mon.noname-a con 0x7fed84058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient(hunting): picked mon.noname-c con 0x7fed84181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901423757 0 0) 0x7f9c6c090500 con 0x7f9c6c08c0c0 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): my global_id is 4302 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed84149850 con 0x7fed84058260 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c54003610 con 0x7f9c6c08c0c0 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8408a870 con 0x7fed84057630 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8412fc30 con 0x7fed84181e80 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed8b1e0640 10 monclient(hunting): authenticate will time out at 609.675415s 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2f00026d0 con 0x7ff2fc058260 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2f0002ad0 con 0x7ff2fc058260 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ea7fc640 10 monclient: dump: 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff2ebfff640 4 set_mon_vals no callback set 2026-02-21T01:27:58.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed7bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fed84058260 0x7fed841704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36356/0 (socket says 10.20.193.43:36356) 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149229130 0 0) 0x7f9c6c0908d0 con 0x7f9c6c090130 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): my global_id is 4252 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c6c090500 con 0x7f9c6c090130 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed7bfff640 1 -- 10.20.193.43:0/4040250158 learned_addr learned my addr 10.20.193.43:0/4040250158 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 client.?.objecter ms_handle_connect 0x7fed84181e80 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 client.?.objecter ms_handle_connect 0x7fed84058260 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 client.?.objecter ms_handle_connect 0x7fed84057630 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346526612 0 0) 0x7fed8412fc30 con 0x7fed84181e80 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): my global_id is 4289 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed54003610 con 0x7fed84181e80 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399990790 0 0) 0x7f9c6c058bc0 con 0x7f9c6c088050 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient(hunting): my global_id is 4286 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c6c0908d0 con 0x7f9c6c088050 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 231471471 0 0) 0x7f9c6c090500 con 0x7f9c6c090130 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 >> v1:10.20.193.43:6790/0 conn(0x7f9c6c088050 legacy=0x7f9c6c1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 >> v1:10.20.193.43:6789/0 conn(0x7f9c6c08c0c0 legacy=0x7f9c6c180310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 monclient: found mon.noname-c 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c08d890 con 0x7f9c6c090130 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9c5c002df0 con 0x7f9c6c090130 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: dump: 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.026 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 5 monclient: authenticate success, global_id 4252 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126536930 0 0) 0x7fed8408a870 con 0x7fed84057630 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): my global_id is 4255 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed8412fc30 con 0x7fed84057630 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient(hunting): picked mon.noname-a con 0x7f7cf805d520 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient(hunting): picked mon.noname-c con 0x7f7cf808c330 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient(hunting): picked mon.noname-b con 0x7f7cf808c770 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 10 monclient: shutdown 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 1 -- 10.20.193.43:0/3205759506 >> v1:10.20.193.43:6789/0 conn(0x7f7a9c057400 legacy=0x7f7a9c1a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c5c002fc0 con 0x7f9c6c090130 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 1 -- 10.20.193.43:0/2583332162 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9c5c003400 con 0x7f9c6c090130 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c71486640 10 monclient: dump: 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f9c74713640 4 set_mon_vals no callback set 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf8194190 con 0x7f7cf805d520 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 10 monclient: build_initial_monmap 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 10 monclient: monmap: 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.028 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 1 librados: starting msgr at 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 1 librados: starting objecter 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1277049519 0 0) 0x7fed8412fc30 con 0x7fed84057630 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf80584f0 con 0x7f7cf808c770 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf808ac10 con 0x7f7cf808c330 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cff7cf640 10 monclient(hunting): authenticate will time out at 609.675603s 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cfcd43640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f7cf808c330 0x7f7cf8216c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53452/0 (socket says 10.20.193.43:53452) 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7cfcd43640 1 -- 10.20.193.43:0/4034837295 learned_addr learned my addr 10.20.193.43:0/4034837295 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 client.?.objecter ms_handle_connect 0x7f7cf808c330 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 1 -- 10.20.193.43:0/3205759506 shutdown_connections 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 1 -- 10.20.193.43:0/3205759506 >> 10.20.193.43:0/3205759506 conn(0x7f7a9c08dd90 msgr2=0x7f7a9c08e190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 1 Processor -- start 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fed8408a870 con 0x7fed84057630 2026-02-21T01:27:58.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fed74003310 con 0x7fed84057630 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 1 -- 10.20.193.43:0/3205759506 shutdown_connections 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): dump: 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881674135 0 0) 0x7f7cf808ac10 con 0x7f7cf808c330 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 monclient(hunting): my global_id is 4292 2026-02-21T01:27:58.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 1 -- start start 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7aa12c9640 1 -- 10.20.193.43:0/3205759506 wait complete. 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 1 librados: setting wanted keys 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 1 librados: calling monclient init 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f60998e1640 10 monclient: init 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc8003610 con 0x7f7cf808c330 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 client.?.objecter ms_handle_connect 0x7f7cf808c770 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7ff304109640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff304109640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7f7ce5ffb640 10 client.?.objecter ms_handle_connect 0x7f7cf805d520 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615420446 0 0) 0x7fed84149850 con 0x7fed84058260 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc0008d0 con 0x7ff2fc058260 2026-02-21T01:27:58.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843007711 0 0) 0x7f7cf80584f0 con 0x7f7cf808c770 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): my global_id is 4258 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff2f0002ad0 con 0x7ff2fc058260 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): my global_id is 4305 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed8412fc30 con 0x7fed84058260 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 330136307 0 0) 0x7fed54003610 con 0x7fed84181e80 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fed84149850 con 0x7fed84181e80 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fed80002c70 con 0x7fed84181e80 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 10 monclient(hunting): dump: 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.032 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1417137661 0 0) 0x7fed8408a870 con 0x7fed84057630 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 >> v1:10.20.193.43:6790/0 conn(0x7fed84181e80 legacy=0x7fed84171c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf808ac10 con 0x7f7cf808c770 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.970+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 >> v1:10.20.193.43:6789/0 conn(0x7fed84058260 legacy=0x7fed841704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 1 monclient: found mon.b 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8412e740 con 0x7fed84057630 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 5 monclient: authenticate success, global_id 4255 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 10 monclient: _renew_subs 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fed84130aa0 con 0x7fed84057630 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 10 client.4255.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 10 monclient: _renew_subs 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fed8414c310 con 0x7fed84057630 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 1 librados: init done 2026-02-21T01:27:58.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fed74002980 con 0x7fed84057630 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fed74004b80 con 0x7fed84057630 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 10 monclient: dump: 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686451322 0 0) 0x7f7cf8194190 con 0x7f7cf805d520 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): my global_id is 4308 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf80584f0 con 0x7f7cf805d520 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f9c74713640 10 monclient: shutdown 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 656749769 0 0) 0x7f7cc8003610 con 0x7f7cf808c330 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cf8194190 con 0x7f7cf808c330 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cec0030c0 con 0x7f7cf808c330 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): dump: 2026-02-21T01:27:58.034 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4180457722 0 0) 0x7f7cf808ac10 con 0x7f7cf808c770 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cc8003610 con 0x7f7cf808c770 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cf4003390 con 0x7f7cf808c770 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): dump: 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3784406632 0 0) 0x7f7cf80584f0 con 0x7f7cf805d520 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cf808ac10 con 0x7f7cf805d520 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7ce8002b60 con 0x7f7cf805d520 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient(hunting): dump: 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.035 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 107119532 0 0) 0x7f7cf8194190 con 0x7f7cf808c330 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 >> v1:10.20.193.46:6789/0 conn(0x7f7cf808c770 legacy=0x7f7cf8238340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7ff2f004da20 con 0x7ff2fc058260 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff2ea7fc640 10 client.4296.objecter ms_dispatch2 0x7ff2fc000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff2ea7fc640 3 client.4296.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 >> v1:10.20.193.43:6789/0 conn(0x7f7cf805d520 legacy=0x7f7cf81a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 monclient: found mon.c 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8194750 con 0x7f7cf808c330 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient(hunting): picked mon.noname-b con 0x7f6094057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff2ea7fc640 3 client.4296.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:58.036 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 5 monclient: authenticate success, global_id 4292 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 monclient: _renew_subs 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient(hunting): picked mon.noname-c con 0x7f6094058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf8193300 con 0x7f7cf808c330 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 client.4292.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 monclient: _renew_subs 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cf818e930 con 0x7f7cf808c330 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 1 librados: init done 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient(hunting): picked mon.noname-a con 0x7f6094181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60941497b0 con 0x7f6094181e80 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609408a870 con 0x7f6094057630 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7aa12c9640 10 monclient: build_initial_monmap 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7aa12c9640 10 monclient: monmap: 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.037 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609412fb90 con 0x7f6094058260 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient(hunting): authenticate will time out at 609.676387s 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cec003450 con 0x7f7cf808c330 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff2ea7fc640 20 client.4296.objecter dump_active .. 0 homeless 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7cec004b80 con 0x7f7cf808c330 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 10 monclient: dump: 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce77fe640 4 set_mon_vals no callback set 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60927fc640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f6094058260 0x7f6094170450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53454/0 (socket says 10.20.193.43:53454) 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60927fc640 1 -- 10.20.193.43:0/4217310163 learned_addr learned my addr 10.20.193.43:0/4217310163 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.038 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff301e7e640 10 monclient: get_auth_request con 0x7ff2cc03edd0 auth_method 0 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7aa12c9640 1 librados: starting msgr at 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7aa12c9640 1 librados: starting objecter 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f9c74713640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 client.?.objecter ms_handle_connect 0x7f6094058260 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f9c74713640 1 -- 10.20.193.43:0/2583332162 >> v1:10.20.193.46:6789/0 conn(0x7f9c6c090130 legacy=0x7f9c6c0584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 client.?.objecter ms_handle_connect 0x7f6094181e80 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7aa12c9640 1 Processor -- start 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed7affd640 4 set_mon_vals no callback set 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 client.?.objecter ms_handle_connect 0x7f6094057630 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7ff2ea7fc640 10 client.4296.objecter ms_handle_connect 0x7ff2cc03edd0 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747355809 0 0) 0x7f609412fb90 con 0x7f6094058260 2026-02-21T01:27:58.039 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f9c74713640 1 -- 10.20.193.43:0/2583332162 shutdown_connections 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): my global_id is 4295 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6064003610 con 0x7f6094058260 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f9c74713640 1 -- 10.20.193.43:0/2583332162 >> 10.20.193.43:0/2583332162 conn(0x7f9c6c091aa0 msgr2=0x7f9c6c08dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed8b1e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130035014 0 0) 0x7f609408a870 con 0x7f6094057630 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): my global_id is 4261 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609412fb90 con 0x7f6094057630 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1152857058 0 0) 0x7f6064003610 con 0x7f6094058260 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f609408a870 con 0x7f6094058260 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f607c003020 con 0x7f6094058260 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:58.040 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): dump: 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fed74011500 con 0x7fed84057630 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3701553661 0 0) 0x7f609408a870 con 0x7f6094058260 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 >> v1:10.20.193.46:6789/0 conn(0x7f6094057630 legacy=0x7f60941490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 >> v1:10.20.193.43:6789/0 conn(0x7f6094181e80 legacy=0x7f6094171b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 monclient: found mon.c 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f7cec011360 con 0x7f7cf808c330 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609412e6a0 con 0x7f6094058260 2026-02-21T01:27:58.041 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f606bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 5 monclient: authenticate success, global_id 4295 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient: _renew_subs 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6094130a00 con 0x7f6094058260 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.971+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf808d7a0 con 0x7f7cf808c330 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f9c74713640 1 -- 10.20.193.43:0/2583332162 shutdown_connections 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 1 -- start start 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 1 librados: setting wanted keys 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 1 librados: calling monclient init 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient: init 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7fed7404dd90 con 0x7fed84057630 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed797fa640 10 client.4255.objecter ms_dispatch2 0x7fed84000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f7cec04dc10 con 0x7f7cf808c330 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7ce5ffb640 10 client.4292.objecter ms_dispatch2 0x7f7cf8000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:58.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7ce5ffb640 3 client.4292.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7ce5ffb640 3 client.4292.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7ce5ffb640 20 client.4292.objecter dump_active .. 0 homeless 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient(hunting): picked mon.noname-c con 0x7f7a9c057400 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient(hunting): picked mon.noname-a con 0x7f7a9c0901a0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient(hunting): picked mon.noname-b con 0x7f7a9c090e20 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c1a8630 con 0x7f7a9c0901a0 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c088480 con 0x7f7a9c090e20 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c1aa0f0 con 0x7f7a9c057400 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 10 client.4295.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7aa12c9640 10 monclient(hunting): authenticate will time out at 609.677437s 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7cfd544640 10 monclient: get_auth_request con 0x7f7cc8047770 auth_method 0 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a9affd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f7a9c057400 0x7f7a9c1a1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53460/0 (socket says 10.20.193.43:53460) 2026-02-21T01:27:58.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a9affd640 1 -- 10.20.193.43:0/165014205 learned_addr learned my addr 10.20.193.43:0/165014205 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 10 monclient: _renew_subs 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f609414c270 con 0x7f6094058260 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 1 librados: init done 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f607c0048d0 con 0x7f6094058260 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f607c004c20 con 0x7f6094058260 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 10 monclient: dump: 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60917fa640 4 set_mon_vals no callback set 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f607c0115a0 con 0x7f6094058260 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a7b7fe640 10 client.?.objecter ms_handle_connect 0x7f7a9c057400 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a7b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.044 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a7b7fe640 10 client.?.objecter ms_handle_connect 0x7f7a9c0901a0 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60940008d0 con 0x7f6094058260 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f607c04dd00 con 0x7f6094058260 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 10 client.4295.objecter ms_dispatch2 0x7f6094000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 3 client.4295.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 3 client.4295.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a7b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a7b7fe640 10 client.?.objecter ms_handle_connect 0x7f7a9c090e20 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7a7b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f606bfff640 20 client.4295.objecter dump_active .. 0 homeless 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed797fa640 3 client.4255.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed797fa640 3 client.4255.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f7ce5ffb640 10 client.4292.objecter ms_handle_connect 0x7f7cc8047770 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed8b1e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed8b1e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:58.045 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed840008d0 con 0x7fed84057630 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed797fa640 20 client.4255.objecter dump_active .. 0 homeless 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed7bfff640 10 monclient: get_auth_request con 0x7fed5403ec40 auth_method 0 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7fed797fa640 10 client.4255.objecter ms_handle_connect 0x7fed5403ec40 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.972+0000 7f6092ffd640 10 monclient: get_auth_request con 0x7f606403e9f0 auth_method 0 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f606bfff640 10 client.4295.objecter ms_handle_connect 0x7f606403e9f0 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 1 -- 10.20.193.43:0/2583332162 wait complete. 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 10 monclient: build_initial_monmap 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 10 monclient: monmap: 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 1 librados: starting msgr at 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 1 librados: starting objecter 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 1 Processor -- start 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 1 -- start start 2026-02-21T01:27:58.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421930243 0 0) 0x7f7a9c1a8630 con 0x7f7a9c0901a0 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f7a7b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f7a7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f7a7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 1 librados: setting wanted keys 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f7a7b7fe640 10 monclient(hunting): my global_id is 4311 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 1 librados: calling monclient init 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a68003610 con 0x7f7a9c0901a0 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.973+0000 7f9c74713640 10 monclient: init 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3013115281 0 0) 0x7f7a68003610 con 0x7f7a9c0901a0 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a9c1a8630 con 0x7f7a9c0901a0 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff2f00173d0 con 0x7ff2fc058260 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a84002cc0 con 0x7f7a9c0901a0 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient(hunting): dump: 2026-02-21T01:27:58.047 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7ff2ea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7ff2ea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 187882483 0 0) 0x7f7a9c1a8630 con 0x7f7a9c0901a0 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 >> v1:10.20.193.43:6790/0 conn(0x7f7a9c057400 legacy=0x7f7a9c1a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 >> v1:10.20.193.46:6789/0 conn(0x7f7a9c090e20 legacy=0x7f7a9c238b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 monclient: found mon.a 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c1a9190 con 0x7f7a9c0901a0 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 5 monclient: authenticate success, global_id 4311 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 monclient: _renew_subs 2026-02-21T01:27:58.048 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c1a9480 con 0x7f7a9c0901a0 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a84003340 con 0x7f7a9c0901a0 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7a84003b20 con 0x7f7a9c0901a0 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 10 monclient(hunting): picked mon.noname-a con 0x7f9c6c088050 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a997fa640 4 set_mon_vals no callback set 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 10 monclient(hunting): picked mon.noname-b con 0x7f9c6c08c0c0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c72488640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f9c6c088050 0x7f9c6c13bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36396/0 (socket says 10.20.193.43:36396) 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:58.049 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c72488640 1 -- 10.20.193.43:0/2728854591 learned_addr learned my addr 10.20.193.43:0/2728854591 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 client.4311.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 10 monclient: dump: 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 monclient: _renew_subs 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 10 monclient(hunting): picked mon.noname-c con 0x7f9c6c090130 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 client.?.objecter ms_handle_connect 0x7f9c6c088050 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a9c1a24a0 con 0x7f7a9c0901a0 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6c12e1b0 con 0x7f9c6c088050 2026-02-21T01:27:58.050 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 1 librados: init done 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6c088480 con 0x7f9c6c08c0c0 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6c0879b0 con 0x7f9c6c090130 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c74713640 10 monclient(hunting): authenticate will time out at 609.679644s 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583936743 0 0) 0x7f9c6c12e1b0 con 0x7f9c6c088050 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): my global_id is 4314 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c3c003610 con 0x7f9c6c088050 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fed74017740 con 0x7fed84057630 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7cec017500 con 0x7f7cf808c330 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7fed797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7ce5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7fed797fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:58.051 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7ce5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f7a840104a0 con 0x7f7a9c0901a0 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 376234114 0 0) 0x7f9c3c003610 con 0x7f9c6c088050 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c6c12e1b0 con 0x7f9c6c088050 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9c5c0033d0 con 0x7f9c6c088050 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): dump: 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 client.?.objecter ms_handle_connect 0x7f9c6c090130 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 client.?.objecter ms_handle_connect 0x7f9c6c08c0c0 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 182976607 0 0) 0x7f9c6c12e1b0 con 0x7f9c6c088050 2026-02-21T01:27:58.052 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 >> v1:10.20.193.43:6790/0 conn(0x7f9c6c090130 legacy=0x7f9c6c191790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c1aa330 con 0x7f7a9c0901a0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.974+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 >> v1:10.20.193.46:6789/0 conn(0x7f9c6c08c0c0 legacy=0x7f9c6c190070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 1 monclient: found mon.a 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c130510 con 0x7f9c6c088050 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 5 monclient: authenticate success, global_id 4314 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 monclient: _renew_subs 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6c12fc70 con 0x7f9c6c088050 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 client.4314.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f7a8404caf0 con 0x7f7a9c0901a0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f7a7b7fe640 10 client.4311.objecter ms_dispatch2 0x7f7a9c000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 monclient: _renew_subs 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f7a7b7fe640 3 client.4311.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:58.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f7a7b7fe640 3 client.4311.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c6c13c3d0 con 0x7f9c6c088050 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 1 librados: init done 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f7a7b7fe640 20 client.4311.objecter dump_active .. 0 homeless 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f7a9affd640 10 monclient: get_auth_request con 0x7f7a6803e990 auth_method 0 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f7a7b7fe640 10 client.4311.objecter ms_handle_connect 0x7f7a6803e990 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.975+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6c0008d0 con 0x7f9c6c088050 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c5c002f50 con 0x7f9c6c088050 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9c5c003b40 con 0x7f9c6c088050 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7a9c1a9480 con 0x7f7a9c0901a0 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f7a7b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f7a7b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 10 monclient: dump: 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c70c85640 4 set_mon_vals no callback set 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f9c5c003d20 con 0x7f9c6c088050 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f9c5c04dd80 con 0x7f9c6c088050 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 10 client.4314.objecter ms_dispatch2 0x7f9c6c000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 3 client.4314.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 3 client.4314.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f607c017650 con 0x7f6094058260 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f606bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f606bfff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.977+0000 7f9c52ffd640 20 client.4314.objecter dump_active .. 0 homeless 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.978+0000 7f9c71c87640 10 monclient: get_auth_request con 0x7f9c3c03e9b0 auth_method 0 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.979+0000 7f9c52ffd640 10 client.4314.objecter ms_handle_connect 0x7f9c3c03e9b0 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.979+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9c5c017730 con 0x7f9c6c088050 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.980+0000 7f9c52ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:58.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:57.980+0000 7f9c52ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:58.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.087+0000 7f7cff7cf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-21T01:27:58.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.087+0000 7f7cff7cf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-21T01:27:58.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.087+0000 7f7cff7cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.087+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7cf8054db0 con 0x7f7cf808c330 2026-02-21T01:27:58.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.087+0000 7f7ce5ffb640 1 -- 10.20.193.43:0/4034837295 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7f7cec01c4e0 con 0x7f7cf808c330 2026-02-21T01:27:58.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.087+0000 7f7ce5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-21T01:27:58.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.087+0000 7f7ce5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stdout:47244640258 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7ff304109640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7ff304109640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7ff304109640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff2fc092830 con 0x7ff2fc058260 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7ff2ea7fc640 1 -- 10.20.193.43:0/2416774133 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7ff2f0016cd0 con 0x7ff2fc058260 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7ff2ea7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7ff2ea7fc640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stdout:47244640258 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7f7aa12c9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7f7aa12c9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7f7aa12c9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.088+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7a9c054e90 con 0x7f7a9c0901a0 2026-02-21T01:27:58.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.089+0000 7f7a7b7fe640 1 -- 10.20.193.43:0/165014205 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 847495621) 0x7f7a84016440 con 0x7f7a9c0901a0 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.089+0000 7f7a7b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.089+0000 7f7a7b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 10 librados: watch_flush enter 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 10 librados: watch_flush exit 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 20 client.4292.objecter shutdown clearing up homeless session... 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 10 client.4292.objecter successfully canceled tick 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 >> v1:10.20.193.46:6812/860801619 conn(0x7f7cc8047770 legacy=0x7f7cc8067c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 10 monclient: shutdown 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 >> v1:10.20.193.43:6790/0 conn(0x7f7cf808c330 legacy=0x7f7cf8216c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 shutdown_connections 2026-02-21T01:27:58.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 >> 10.20.193.43:0/4034837295 conn(0x7f7cf8091ad0 msgr2=0x7f7cf81a91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 shutdown_connections 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 1 -- 10.20.193.43:0/4034837295 wait complete. 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.090+0000 7f7cff7cf640 1 librados: shutdown 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 10 librados: watch_flush enter 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 10 librados: watch_flush exit 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 20 client.4296.objecter shutdown clearing up homeless session... 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 10 client.4296.objecter successfully canceled tick 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 >> v1:10.20.193.46:6812/860801619 conn(0x7ff2cc03edd0 legacy=0x7ff2cc05f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 10 monclient: shutdown 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 >> v1:10.20.193.43:6789/0 conn(0x7ff2fc058260 legacy=0x7ff2fc1704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 shutdown_connections 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 >> 10.20.193.43:0/2416774133 conn(0x7ff2fc090360 msgr2=0x7ff2fc08aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 shutdown_connections 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 1 -- 10.20.193.43:0/2416774133 wait complete. 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7ff304109640 1 librados: shutdown 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7fed8b1e0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7fed8b1e0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-21T01:27:58.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7fed8b1e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fed84092830 con 0x7fed84057630 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 10 librados: watch_flush enter 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 10 librados: watch_flush exit 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 20 client.4311.objecter shutdown clearing up homeless session... 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 10 client.4311.objecter successfully canceled tick 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 >> v1:10.20.193.46:6812/860801619 conn(0x7f7a6803e990 legacy=0x7f7a6805ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7fed797fa640 1 -- 10.20.193.43:0/4040250158 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7fed74017040 con 0x7fed84057630 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7fed797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7fed797fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 10 monclient: shutdown 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 >> v1:10.20.193.43:6789/0 conn(0x7f7a9c0901a0 legacy=0x7f7a9c217430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 shutdown_connections 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 >> 10.20.193.43:0/165014205 conn(0x7f7a9c08dd90 msgr2=0x7f7a9c085de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stdout:47244640258 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 shutdown_connections 2026-02-21T01:27:58.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 1 -- 10.20.193.43:0/165014205 wait complete. 2026-02-21T01:27:58.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.091+0000 7f7aa12c9640 1 librados: shutdown 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 10 librados: watch_flush enter 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 10 librados: watch_flush exit 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 20 client.4255.objecter shutdown clearing up homeless session... 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 10 client.4255.objecter successfully canceled tick 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 >> v1:10.20.193.46:6812/860801619 conn(0x7fed5403ec40 legacy=0x7fed5405f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 10 monclient: shutdown 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 >> v1:10.20.193.46:6789/0 conn(0x7fed84057630 legacy=0x7fed84149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 shutdown_connections 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 >> 10.20.193.43:0/4040250158 conn(0x7fed84090360 msgr2=0x7fed8408aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 shutdown_connections 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 1 -- 10.20.193.43:0/4040250158 wait complete. 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7fed8b1e0640 1 librados: shutdown 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7f60998e1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-21T01:27:58.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7f60998e1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7f60998e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6094054d90 con 0x7f6094058260 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7f606bfff640 1 -- 10.20.193.43:0/4217310163 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7f607c016f50 con 0x7f6094058260 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7f606bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.094+0000 7f606bfff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stdout:47244640258 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.095+0000 7f9c74713640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.095+0000 7f9c74713640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.095+0000 7f9c74713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.095+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9c6c14ef80 con 0x7f9c6c088050 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.095+0000 7f9c52ffd640 1 -- 10.20.193.43:0/2728854591 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 847495621) 0x7f9c5c01c650 con 0x7f9c6c088050 2026-02-21T01:27:58.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.095+0000 7f9c52ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-21T01:27:58.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.095+0000 7f9c52ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:58.097 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 10 librados: watch_flush enter 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 10 librados: watch_flush exit 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 20 client.4295.objecter shutdown clearing up homeless session... 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 10 client.4295.objecter successfully canceled tick 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 >> v1:10.20.193.46:6812/860801619 conn(0x7f606403e9f0 legacy=0x7f606405eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 10 monclient: shutdown 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 >> v1:10.20.193.43:6790/0 conn(0x7f6094058260 legacy=0x7f6094170450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 shutdown_connections 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 >> 10.20.193.43:0/4217310163 conn(0x7f6094090360 msgr2=0x7f609408aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 shutdown_connections 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.097+0000 7f60998e1640 1 -- 10.20.193.43:0/4217310163 wait complete. 2026-02-21T01:27:58.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f60998e1640 1 librados: shutdown 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 10 librados: watch_flush enter 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 10 librados: watch_flush exit 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 20 client.4314.objecter shutdown clearing up homeless session... 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 10 client.4314.objecter successfully canceled tick 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 >> v1:10.20.193.46:6812/860801619 conn(0x7f9c3c03e9b0 legacy=0x7f9c3c05ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 10 monclient: shutdown 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 >> v1:10.20.193.43:6789/0 conn(0x7f9c6c088050 legacy=0x7f9c6c13bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 shutdown_connections 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 >> 10.20.193.43:0/2728854591 conn(0x7f9c6c091aa0 msgr2=0x7f9c6c08dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 shutdown_connections 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 1 -- 10.20.193.43:0/2728854591 wait complete. 2026-02-21T01:27:58.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:58.098+0000 7f9c74713640 1 librados: shutdown 2026-02-21T01:27:58.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2026-02-21T01:27:58.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-21T01:27:58.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.5 2026-02-21T01:27:58.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-21T01:27:58.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-21T01:27:58.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.4 2026-02-21T01:27:59.101 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-21T01:27:59.102 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-21T01:27:59.103 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-21T01:27:59.105 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-21T01:27:59.108 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-21T01:27:59.108 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-21T01:27:59.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7f47e2867640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7f47e2867640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7f47e2867640 10 monclient: monmap: 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.172729+0000 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.172729+0000 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7f47e2867640 1 Processor -- start 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7fd4a0bac640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7fd4a0bac640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7fd4a0bac640 10 monclient: monmap: 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.173127+0000 2026-02-21T01:27:59.174 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.173127+0000 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7f47e2867640 1 -- start start 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7f47e2867640 10 monclient: init 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7fceb2783640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7fceb2783640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.172+0000 7fceb2783640 10 monclient: monmap: 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.173127+0000 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.173127+0000 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.175 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient(hunting): picked mon.noname-a con 0x7f47dc058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient(hunting): picked mon.noname-c con 0x7f47dc057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient(hunting): picked mon.noname-b con 0x7f47dc181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc056c50 con 0x7f47dc058260 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc08eda0 con 0x7f47dc057630 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc08f5c0 con 0x7f47dc181e80 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient(hunting): authenticate will time out at 610.878229s 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 1 Processor -- start 2026-02-21T01:27:59.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 1 Processor -- start 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 1 -- start start 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient: init 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e0ddd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f47dc181e80 0x7f47dc1a2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53484/0 (socket says 10.20.193.43:53484) 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e0ddd640 1 -- 10.20.193.43:0/2735095363 learned_addr learned my addr 10.20.193.43:0/2735095363 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 1 -- start start 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient: init 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47dbfff640 1 --1- 10.20.193.43:0/2735095363 >> v1:10.20.193.43:6789/0 conn(0x7f47dc058260 0x7f47dc08df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36406/0 (socket says 10.20.193.43:36406) 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546694918 0 0) 0x7f47dc08f5c0 con 0x7f47dc181e80 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): my global_id is 4298 2026-02-21T01:27:59.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c0003610 con 0x7f47dc181e80 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136886498 0 0) 0x7f47dc056c50 con 0x7f47dc058260 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient(hunting): my global_id is 4317 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47dc08f5c0 con 0x7f47dc058260 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3277907855 0 0) 0x7f47c0003610 con 0x7f47dc181e80 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 >> v1:10.20.193.46:6789/0 conn(0x7f47dc057630 legacy=0x7f47dc08e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 >> v1:10.20.193.43:6789/0 conn(0x7f47dc058260 legacy=0x7f47dc08df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 monclient: found mon.noname-b 2026-02-21T01:27:59.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc0563b0 con 0x7f47dc181e80 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient(hunting): picked mon.noname-c con 0x7fceac05cef0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f47d0003170 con 0x7f47dc181e80 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 5 monclient: authenticate success, global_id 4298 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient(hunting): picked mon.noname-b con 0x7fd49c181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.180 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient(hunting): picked mon.noname-b con 0x7fceac08a730 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.180 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c056c50 con 0x7fd49c058260 2026-02-21T01:27:59.180 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient(hunting): picked mon.noname-a con 0x7fceac13fa20 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.180 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac05d9d0 con 0x7fceac13fa20 2026-02-21T01:27:59.180 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac08b590 con 0x7fceac05cef0 2026-02-21T01:27:59.180 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac05b9c0 con 0x7fceac08a730 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c08eda0 con 0x7fd49c057630 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c08f5c0 con 0x7fd49c181e80 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd4a0bac640 10 monclient(hunting): authenticate will time out at 610.878671s 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceb2783640 10 monclient(hunting): authenticate will time out at 610.878675s 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd49a575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd49c058260 0x7fd49c08df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36410/0 (socket says 10.20.193.43:36410) 2026-02-21T01:27:59.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd49a575640 1 -- 10.20.193.43:0/3627719362 learned_addr learned my addr 10.20.193.43:0/3627719362 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceab7fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fceac08a730 0x7fceac180300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53498/0 (socket says 10.20.193.43:53498) 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceab7fe640 1 -- 10.20.193.43:0/1398497476 learned_addr learned my addr 10.20.193.43:0/1398497476 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: dump: 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47d00033c0 con 0x7f47dc181e80 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 1 -- 10.20.193.43:0/2735095363 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f47d0003800 con 0x7f47dc181e80 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 4 set_mon_vals no callback set 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47daffd640 10 monclient: dump: 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.183 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424760909 0 0) 0x7fd49c056c50 con 0x7fd49c058260 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): my global_id is 4320 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd488003610 con 0x7fd49c058260 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8175016 0 0) 0x7fd49c08f5c0 con 0x7fd49c181e80 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 10 monclient: shutdown 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- 10.20.193.43:0/2735095363 >> v1:10.20.193.43:6790/0 conn(0x7f47dc181e80 legacy=0x7f47dc1a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient(hunting): my global_id is 4301 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c056c50 con 0x7fd49c181e80 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413684121 0 0) 0x7fceac05d9d0 con 0x7fceac13fa20 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): my global_id is 4323 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce90003610 con 0x7fceac13fa20 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651392716 0 0) 0x7fceac05b9c0 con 0x7fceac08a730 2026-02-21T01:27:59.185 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- 10.20.193.43:0/2735095363 shutdown_connections 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- 10.20.193.43:0/2735095363 >> 10.20.193.43:0/2735095363 conn(0x7f47dc090360 msgr2=0x7f47dc090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 10 monclient(hunting): my global_id is 4304 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceac05d9d0 con 0x7fceac08a730 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- 10.20.193.43:0/2735095363 shutdown_connections 2026-02-21T01:27:59.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7f47e2867640 1 -- 10.20.193.43:0/2735095363 wait complete. 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4023079497 0 0) 0x7fd49c056c50 con 0x7fd49c181e80 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 >> v1:10.20.193.46:6789/0 conn(0x7fd49c057630 legacy=0x7fd49c08e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 >> v1:10.20.193.43:6789/0 conn(0x7fd49c058260 legacy=0x7fd49c08df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.173+0000 7fd499573640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 1 monclient: found mon.noname-b 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c0563b0 con 0x7fd49c181e80 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd48c003170 con 0x7fd49c181e80 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1196620756 0 0) 0x7fceac05d9d0 con 0x7fceac08a730 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 >> v1:10.20.193.46:6789/0 conn(0x7fceac05cef0 legacy=0x7fceac05d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: dump: 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 5 monclient: authenticate success, global_id 4301 2026-02-21T01:27:59.188 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 >> v1:10.20.193.43:6789/0 conn(0x7fceac13fa20 legacy=0x7fceac1a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 monclient: found mon.noname-b 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac13f210 con 0x7fceac08a730 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fce9c002df0 con 0x7fceac08a730 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:59.189 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: dump: 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 5 monclient: authenticate success, global_id 4304 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd48c003340 con 0x7fd49c181e80 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 1 -- 10.20.193.43:0/3627719362 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd48c003780 con 0x7fd49c181e80 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 4 set_mon_vals no callback set 2026-02-21T01:27:59.190 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd499573640 10 monclient: dump: 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce9c003030 con 0x7fceac08a730 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 1 -- 10.20.193.43:0/1398497476 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fce9c003470 con 0x7fceac08a730 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceaaffd640 10 monclient: dump: 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.191 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 4 set_mon_vals no callback set 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 10 monclient: shutdown 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 -- 10.20.193.43:0/3627719362 >> v1:10.20.193.43:6790/0 conn(0x7fd49c181e80 legacy=0x7fd49c1a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient: monmap: 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.192 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 -- 10.20.193.43:0/3627719362 shutdown_connections 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 -- 10.20.193.43:0/3627719362 >> 10.20.193.43:0/3627719362 conn(0x7fd49c090360 msgr2=0x7fd49c090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 10 monclient: shutdown 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 1 -- 10.20.193.43:0/1398497476 >> v1:10.20.193.43:6790/0 conn(0x7fceac08a730 legacy=0x7fceac180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 -- 10.20.193.43:0/3627719362 shutdown_connections 2026-02-21T01:27:59.193 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 -- 10.20.193.43:0/3627719362 wait complete. 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 1 -- 10.20.193.43:0/1398497476 shutdown_connections 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 1 -- 10.20.193.43:0/1398497476 >> 10.20.193.43:0/1398497476 conn(0x7fceac08f480 msgr2=0x7fceac08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 1 -- 10.20.193.43:0/1398497476 shutdown_connections 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 1 -- 10.20.193.43:0/1398497476 wait complete. 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 librados: starting msgr at 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 librados: starting objecter 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 Processor -- start 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 -- start start 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 librados: setting wanted keys 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 librados: calling monclient init 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient: init 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 10 monclient: monmap: 2026-02-21T01:27:59.194 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 10 monclient: monmap: 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 1 librados: starting msgr at 2026-02-21T01:27:59.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fceb2783640 1 librados: starting objecter 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient(hunting): picked mon.noname-b con 0x7f47dc057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient(hunting): picked mon.noname-a con 0x7f47dc058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient(hunting): picked mon.noname-c con 0x7f47dc181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc149970 con 0x7f47dc058260 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc130bc0 con 0x7f47dc057630 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc12fd50 con 0x7f47dc181e80 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7f47e2867640 10 monclient(hunting): authenticate will time out at 610.879941s 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 librados: starting msgr at 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 librados: starting objecter 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.174+0000 7fd4a0bac640 1 Processor -- start 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 1 -- start start 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 1 librados: setting wanted keys 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 1 librados: calling monclient init 2026-02-21T01:27:59.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 1 Processor -- start 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient: init 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e0ddd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f47dc181e80 0x7f47dc171d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53510/0 (socket says 10.20.193.43:53510) 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e0ddd640 1 -- 10.20.193.43:0/2155495901 learned_addr learned my addr 10.20.193.43:0/2155495901 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 1 -- start start 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 1 librados: setting wanted keys 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 1 librados: calling monclient init 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient: init 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47db7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f47dc058260 0x7f47dc170610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36424/0 (socket says 10.20.193.43:36424) 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 client.?.objecter ms_handle_connect 0x7f47dc181e80 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 client.?.objecter ms_handle_connect 0x7f47dc058260 2026-02-21T01:27:59.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976371371 0 0) 0x7f47dc12fd50 con 0x7f47dc181e80 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): my global_id is 4307 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47ac003610 con 0x7f47dc181e80 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948889453 0 0) 0x7f47dc149970 con 0x7f47dc058260 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): my global_id is 4326 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47dc12fd50 con 0x7f47dc058260 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 client.?.objecter ms_handle_connect 0x7f47dc057630 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 170110484 0 0) 0x7f47ac003610 con 0x7f47dc181e80 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47dc149970 con 0x7f47dc181e80 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f47d0003570 con 0x7f47dc181e80 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient(hunting): picked mon.noname-b con 0x7fd49c181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c1495e0 con 0x7fd49c057630 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c130830 con 0x7fd49c181e80 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c12f9c0 con 0x7fd49c058260 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd4a0bac640 10 monclient(hunting): authenticate will time out at 610.880304s 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient(hunting): picked mon.noname-a con 0x7fceac05cef0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient(hunting): picked mon.noname-b con 0x7fceac08a730 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient(hunting): picked mon.noname-c con 0x7fceac13fa20 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac12b400 con 0x7fceac05cef0 2026-02-21T01:27:59.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd49a575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd49c057630 0x7fd49c148ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36438/0 (socket says 10.20.193.43:36438) 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd49a575640 1 -- 10.20.193.43:0/2197070218 learned_addr learned my addr 10.20.193.43:0/2197070218 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd499d74640 1 --1- 10.20.193.43:0/2197070218 >> v1:10.20.193.43:6790/0 conn(0x7fd49c058260 0x7fd49c170280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53518/0 (socket says 10.20.193.43:53518) 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1828582440 0 0) 0x7f47dc149970 con 0x7f47dc181e80 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 >> v1:10.20.193.46:6789/0 conn(0x7f47dc057630 legacy=0x7f47dc149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 >> v1:10.20.193.43:6789/0 conn(0x7f47dc058260 legacy=0x7f47dc170610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 monclient: found mon.c 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac12b9d0 con 0x7fceac08a730 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc12e860 con 0x7f47dc181e80 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceac129270 con 0x7fceac13fa20 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb2783640 10 monclient(hunting): authenticate will time out at 610.880444s 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb0cf9640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fceac13fa20 0x7fceac191120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53530/0 (socket says 10.20.193.43:53530) 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fceb0cf9640 1 -- 10.20.193.43:0/2403144926 learned_addr learned my addr 10.20.193.43:0/2403144926 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 5 monclient: authenticate success, global_id 4307 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 10 monclient: _renew_subs 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47dc130380 con 0x7f47dc181e80 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 10 client.4307.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 10 monclient: _renew_subs 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 client.?.objecter ms_handle_connect 0x7fd49c057630 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 client.?.objecter ms_handle_connect 0x7fd49c058260 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f47dc12f5a0 con 0x7f47dc181e80 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47e2867640 1 librados: init done 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 client.?.objecter ms_handle_connect 0x7fceac13fa20 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47d00033a0 con 0x7f47dc181e80 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f47d0005060 con 0x7f47dc181e80 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47da7fc640 4 set_mon_vals no callback set 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7f47d8ff9640 10 monclient: dump: 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.203 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 client.?.objecter ms_handle_connect 0x7fceac05cef0 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027181456 0 0) 0x7fd49c12f9c0 con 0x7fd49c058260 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 monclient(hunting): my global_id is 4310 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd468003610 con 0x7fd49c058260 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 client.?.objecter ms_handle_connect 0x7fceac08a730 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 client.?.objecter ms_handle_connect 0x7fd49c181e80 2026-02-21T01:27:59.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fd482ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578373308 0 0) 0x7fceac12b400 con 0x7fceac05cef0 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): my global_id is 4332 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce7c003610 con 0x7fceac05cef0 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070131367 0 0) 0x7fceac13f210 con 0x7fceac08a730 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): my global_id is 4270 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceac12b400 con 0x7fceac08a730 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1316256906 0 0) 0x7fce7c003610 con 0x7fceac05cef0 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fceac13f210 con 0x7fceac05cef0 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fce98002ed0 con 0x7fceac05cef0 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.205 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.175+0000 7fcea8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47e2867640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1760266645 0 0) 0x7fceac12b400 con 0x7fceac08a730 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce7c003610 con 0x7fceac08a730 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 839128241 0 0) 0x7fceac13f210 con 0x7fceac05cef0 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 >> v1:10.20.193.43:6790/0 conn(0x7fceac13fa20 legacy=0x7fceac191120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 >> v1:10.20.193.46:6789/0 conn(0x7fceac08a730 legacy=0x7fceac128b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 monclient: found mon.a 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac129f10 con 0x7fceac05cef0 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47e2867640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47e2867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2505904067 0 0) 0x7fd468003610 con 0x7fd49c058260 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49c12f9c0 con 0x7fd49c058260 2026-02-21T01:27:59.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594595594 0 0) 0x7fd49c130830 con 0x7fd49c181e80 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): my global_id is 4273 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd468003610 con 0x7fd49c181e80 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026493371 0 0) 0x7fd49c1495e0 con 0x7fd49c057630 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): my global_id is 4329 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c130830 con 0x7fd49c057630 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd484003f10 con 0x7fd49c058260 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): dump: 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 5 monclient: authenticate success, global_id 4332 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f47d00119e0 con 0x7f47dc181e80 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47dc0008d0 con 0x7f47dc181e80 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 10 monclient: _renew_subs 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3414485132 0 0) 0x7fd49c12f9c0 con 0x7fd49c058260 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 >> v1:10.20.193.46:6789/0 conn(0x7fd49c181e80 legacy=0x7fd49c1719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 >> v1:10.20.193.43:6789/0 conn(0x7fd49c057630 legacy=0x7fd49c148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 monclient: found mon.c 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c12e4d0 con 0x7fd49c058260 2026-02-21T01:27:59.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd482ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 5 monclient: authenticate success, global_id 4310 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 monclient: _renew_subs 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c12fff0 con 0x7fd49c058260 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fceac05e190 con 0x7fceac05cef0 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 10 client.4332.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 10 monclient: _renew_subs 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fceac13bbb0 con 0x7fceac05cef0 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceb2783640 1 librados: init done 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f47d004e0d0 con 0x7f47dc181e80 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 client.4310.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 monclient: _renew_subs 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd49c12f210 con 0x7fd49c058260 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 1 librados: init done 2026-02-21T01:27:59.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47d8ff9640 10 client.4307.objecter ms_dispatch2 0x7f47dc000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47d8ff9640 3 client.4307.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47d8ff9640 3 client.4307.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47d8ff9640 20 client.4307.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47dbfff640 10 monclient: get_auth_request con 0x7f47ac03e9e0 auth_method 0 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7f47d8ff9640 10 client.4307.objecter ms_handle_connect 0x7f47ac03e9e0 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce98003070 con 0x7fceac05cef0 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fce98003730 con 0x7fceac05cef0 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fcea8ff9640 10 monclient: dump: 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.210 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fceaa7fc640 4 set_mon_vals no callback set 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fce867fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.176+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd49c1303e0 con 0x7fd49c058260 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fce867fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fce867fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fce980100f0 con 0x7fceac05cef0 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceac12c380 con 0x7fceac05cef0 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7fce9804c9c0 con 0x7fceac05cef0 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fcea8ff9640 10 client.4332.objecter ms_dispatch2 0x7fceac000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fcea8ff9640 3 client.4332.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fcea8ff9640 3 client.4332.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:59.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fcea8ff9640 20 client.4332.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fceab7fe640 10 monclient: get_auth_request con 0x7fce7c03e9d0 auth_method 0 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.177+0000 7fcea8ff9640 10 client.4332.objecter ms_handle_connect 0x7fce7c03e9d0 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4840040b0 con 0x7fd49c058260 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd482ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd484002870 con 0x7fd49c058260 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd482ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd482ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd498d72640 4 set_mon_vals no callback set 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd482ffd640 10 monclient: dump: 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f47dc130380 con 0x7f47dc181e80 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7f47d8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7f47d8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.178+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fd484002a90 con 0x7fd49c058260 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7fd48404da80 con 0x7fd49c058260 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fd482ffd640 10 client.4310.objecter ms_dispatch2 0x7fd49c000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fd482ffd640 3 client.4310.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fd482ffd640 3 client.4310.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fd482ffd640 20 client.4310.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fce98016310 con 0x7fceac05cef0 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fcea8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fcea8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fd49a575640 10 monclient: get_auth_request con 0x7fd46803e5d0 auth_method 0 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.179+0000 7fd482ffd640 10 client.4310.objecter ms_handle_connect 0x7fd46803e5d0 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.180+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd49c1303e0 con 0x7fd49c058260 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.180+0000 7fd482ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.180+0000 7fd482ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.217+0000 7faf9505b640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.217+0000 7faf9505b640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.217+0000 7faf9505b640 10 monclient: monmap: 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.218127+0000 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.218127+0000 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.219 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.217+0000 7fefe956f640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.217+0000 7fefe956f640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.217+0000 7fefe956f640 10 monclient: monmap: 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.218323+0000 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.218323+0000 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 1 Processor -- start 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 1 -- start start 2026-02-21T01:27:59.220 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient: init 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 1 Processor -- start 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 1 -- start start 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient: init 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient(hunting): picked mon.noname-a con 0x7faf9008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient(hunting): picked mon.noname-b con 0x7faf9008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient(hunting): picked mon.noname-c con 0x7faf9008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9008a690 con 0x7faf9008ddb0 2026-02-21T01:27:59.221 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9008b910 con 0x7faf9008d8d0 2026-02-21T01:27:59.222 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf90088ae0 con 0x7faf9008d4d0 2026-02-21T01:27:59.222 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.222 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf9505b640 10 monclient(hunting): authenticate will time out at 610.923525s 2026-02-21T01:27:59.222 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8ed76640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7faf9008ddb0 0x7faf9008e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36460/0 (socket says 10.20.193.43:36460) 2026-02-21T01:27:59.222 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8ed76640 1 -- 10.20.193.43:0/357878848 learned_addr learned my addr 10.20.193.43:0/357878848 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.222 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.222 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient(hunting): picked mon.noname-b con 0x7fefe40901a0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient(hunting): picked mon.noname-a con 0x7fefe4090e20 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient(hunting): picked mon.noname-c con 0x7fefe4057400 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe4090570 con 0x7fefe4090e20 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe40882a0 con 0x7fefe4057400 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe408c9b0 con 0x7fefe40901a0 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe956f640 10 monclient(hunting): authenticate will time out at 610.923715s 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe2ffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fefe40901a0 0x7fefe408bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53548/0 (socket says 10.20.193.43:53548) 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe2ffd640 1 -- 10.20.193.43:0/2545136131 learned_addr learned my addr 10.20.193.43:0/2545136131 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648868894 0 0) 0x7faf90088ae0 con 0x7faf9008d4d0 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): my global_id is 4316 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7f1eda3e0640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7f1eda3e0640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7f1eda3e0640 10 monclient: monmap: 2026-02-21T01:27:59.223 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.219162+0000 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.219162+0000 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf7c003610 con 0x7faf9008d4d0 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136797555 0 0) 0x7faf9008a690 con 0x7faf9008ddb0 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): my global_id is 4335 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf90088ae0 con 0x7faf9008ddb0 2026-02-21T01:27:59.224 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809984117 0 0) 0x7fefe4090570 con 0x7fefe4090e20 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): my global_id is 4338 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd0003610 con 0x7fefe4090e20 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3373566719 0 0) 0x7fefe408c9b0 con 0x7fefe40901a0 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 10 monclient(hunting): my global_id is 4319 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680049908 0 0) 0x7faf9008b910 con 0x7faf9008d8d0 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 10 monclient(hunting): my global_id is 4276 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefe4090570 con 0x7fefe40901a0 2026-02-21T01:27:59.225 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.218+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf9008a690 con 0x7faf9008d8d0 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3071083587 0 0) 0x7faf90088ae0 con 0x7faf9008ddb0 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 >> v1:10.20.193.43:6790/0 conn(0x7faf9008d4d0 legacy=0x7faf9017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 >> v1:10.20.193.46:6789/0 conn(0x7faf9008d8d0 legacy=0x7faf9019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 monclient: found mon.noname-a 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3337313051 0 0) 0x7fefd0003610 con 0x7fefe4090e20 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf901a3ef0 con 0x7faf9008ddb0 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 >> v1:10.20.193.43:6790/0 conn(0x7fefe40901a0 legacy=0x7fefe408bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 >> v1:10.20.193.46:6789/0 conn(0x7fefe4057400 legacy=0x7fefe41a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 5 monclient: authenticate success, global_id 4335 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7faf84002df0 con 0x7faf9008ddb0 2026-02-21T01:27:59.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 monclient: found mon.noname-a 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe4056fe0 con 0x7fefe4090e20 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefcc002df0 con 0x7fefe4090e20 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 5 monclient: authenticate success, global_id 4338 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: dump: 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.227 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: dump: 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.228 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf840030b0 con 0x7faf9008ddb0 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 1 -- 10.20.193.43:0/357878848 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7faf840034f0 con 0x7faf9008ddb0 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf8dd74640 10 monclient: dump: 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 4 set_mon_vals no callback set 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefcc003040 con 0x7fefe4090e20 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 1 -- 10.20.193.43:0/2545136131 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefcc003480 con 0x7fefe4090e20 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 4 set_mon_vals no callback set 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.229 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe1ffb640 10 monclient: dump: 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 1 Processor -- start 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 1 -- start start 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient: init 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 10 monclient: shutdown 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 10 monclient: shutdown 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 1 -- 10.20.193.43:0/2545136131 >> v1:10.20.193.43:6789/0 conn(0x7fefe4090e20 legacy=0x7fefe408c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 1 -- 10.20.193.43:0/357878848 >> v1:10.20.193.43:6789/0 conn(0x7faf9008ddb0 legacy=0x7faf9008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 1 -- 10.20.193.43:0/2545136131 shutdown_connections 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 1 -- 10.20.193.43:0/2545136131 >> 10.20.193.43:0/2545136131 conn(0x7fefe408dd90 msgr2=0x7fefe408e190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 1 -- 10.20.193.43:0/2545136131 shutdown_connections 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 1 -- 10.20.193.43:0/357878848 shutdown_connections 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 1 -- 10.20.193.43:0/357878848 >> 10.20.193.43:0/357878848 conn(0x7faf9008f480 msgr2=0x7faf9008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7fefe956f640 1 -- 10.20.193.43:0/2545136131 wait complete. 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 1 -- 10.20.193.43:0/357878848 shutdown_connections 2026-02-21T01:27:59.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7faf9505b640 1 -- 10.20.193.43:0/357878848 wait complete. 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient(hunting): picked mon.noname-a con 0x7f1ed40580b0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient(hunting): picked mon.noname-b con 0x7f1ed4058480 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient(hunting): picked mon.noname-c con 0x7f1ed4181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed40562b0 con 0x7f1ed40580b0 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed4056590 con 0x7f1ed4181e80 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed4056870 con 0x7f1ed4058480 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1eda3e0640 10 monclient(hunting): authenticate will time out at 610.924743s 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed3fff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f1ed40580b0 0x7f1ed408e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36464/0 (socket says 10.20.193.43:36464) 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed3fff640 1 -- 10.20.193.43:0/1799190390 learned_addr learned my addr 10.20.193.43:0/1799190390 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838046340 0 0) 0x7f1ed4056870 con 0x7f1ed4058480 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): my global_id is 4322 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1eb8003610 con 0x7f1ed4058480 2026-02-21T01:27:59.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385538304 0 0) 0x7f1ed40562b0 con 0x7f1ed40580b0 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 10 monclient(hunting): my global_id is 4341 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.219+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ed4056870 con 0x7f1ed40580b0 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3036123618 0 0) 0x7f1eb8003610 con 0x7f1ed4058480 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 >> v1:10.20.193.46:6789/0 conn(0x7f1ed4181e80 legacy=0x7f1ed41a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 >> v1:10.20.193.43:6789/0 conn(0x7f1ed40580b0 legacy=0x7f1ed408e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 monclient: found mon.noname-b 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed40931d0 con 0x7f1ed4058480 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1ec4002df0 con 0x7f1ed4058480 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: dump: 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.233 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient: monmap: 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient: monmap: 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.234 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ec4003080 con 0x7f1ed4058480 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 5 monclient: authenticate success, global_id 4322 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 1 -- 10.20.193.43:0/1799190390 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1ec40034c0 con 0x7f1ed4058480 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1ed2ffd640 10 monclient: dump: 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 4 set_mon_vals no callback set 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 librados: starting msgr at 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 librados: starting objecter 2026-02-21T01:27:59.235 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 librados: starting msgr at 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 librados: starting objecter 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 Processor -- start 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 Processor -- start 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 -- start start 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 librados: setting wanted keys 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 librados: calling monclient init 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient: init 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 -- start start 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 librados: setting wanted keys 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 librados: calling monclient init 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient: init 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 10 monclient: shutdown 2026-02-21T01:27:59.236 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1799190390 >> v1:10.20.193.43:6790/0 conn(0x7f1ed4058480 legacy=0x7f1ed408e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1799190390 shutdown_connections 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1799190390 >> 10.20.193.43:0/1799190390 conn(0x7f1ed4094200 msgr2=0x7f1ed4090180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1799190390 shutdown_connections 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient(hunting): picked mon.noname-b con 0x7faf9008d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient(hunting): picked mon.noname-c con 0x7faf9008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1799190390 wait complete. 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient(hunting): picked mon.noname-a con 0x7faf9008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf90107220 con 0x7faf9008ddb0 2026-02-21T01:27:59.237 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf90109580 con 0x7faf9008d4d0 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf90108ce0 con 0x7faf9008d8d0 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf9505b640 10 monclient(hunting): authenticate will time out at 610.925591s 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient(hunting): picked mon.noname-a con 0x7fefe4057400 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf8e575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7faf9008d8d0 0x7faf9018d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53556/0 (socket says 10.20.193.43:53556) 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf8e575640 1 -- 10.20.193.43:0/4258484463 learned_addr learned my addr 10.20.193.43:0/4258484463 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient(hunting): picked mon.noname-b con 0x7fefe40901a0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient(hunting): picked mon.noname-c con 0x7fefe4090e20 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe40878e0 con 0x7fefe4057400 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe41a9600 con 0x7fefe40901a0 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe41ab960 con 0x7fefe4090e20 2026-02-21T01:27:59.238 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 client.?.objecter ms_handle_connect 0x7faf9008d8d0 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe956f640 10 monclient(hunting): authenticate will time out at 610.925684s 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 client.?.objecter ms_handle_connect 0x7faf9008ddb0 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe2ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fefe4057400 0x7fefe41ac0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36476/0 (socket says 10.20.193.43:36476) 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefe2ffd640 1 -- 10.20.193.43:0/3781382331 learned_addr learned my addr 10.20.193.43:0/3781382331 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631118825 0 0) 0x7faf90108ce0 con 0x7faf9008d8d0 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): my global_id is 4325 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 client.?.objecter ms_handle_connect 0x7fefe4057400 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.239 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 client.?.objecter ms_handle_connect 0x7fefe4090e20 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf5c003610 con 0x7faf9008d8d0 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361965829 0 0) 0x7faf90107220 con 0x7faf9008ddb0 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): my global_id is 4344 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf90108ce0 con 0x7faf9008ddb0 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 client.?.objecter ms_handle_connect 0x7faf9008d4d0 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113813554 0 0) 0x7fefe41ab960 con 0x7fefe4090e20 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): my global_id is 4328 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefb0003610 con 0x7fefe4090e20 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3725364525 0 0) 0x7fefe40878e0 con 0x7fefe4057400 2026-02-21T01:27:59.240 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 10 monclient(hunting): my global_id is 4347 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefe41ab960 con 0x7fefe4057400 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2653506938 0 0) 0x7faf5c003610 con 0x7faf9008d8d0 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf90107220 con 0x7faf9008d8d0 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7faf780030f0 con 0x7faf9008d8d0 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): dump: 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.241 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 178477700 0 0) 0x7faf90108ce0 con 0x7faf9008ddb0 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf5c003610 con 0x7faf9008ddb0 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7faf80003390 con 0x7faf9008ddb0 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): dump: 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860056345 0 0) 0x7faf90109580 con 0x7faf9008d4d0 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 10 monclient(hunting): my global_id is 4285 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2695294208 0 0) 0x7fefb0003610 con 0x7fefe4090e20 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf90108ce0 con 0x7faf9008d4d0 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.220+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefe40878e0 con 0x7fefe4090e20 2026-02-21T01:27:59.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 client.?.objecter ms_handle_connect 0x7fefe40901a0 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefd4003520 con 0x7fefe4090e20 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2659079996 0 0) 0x7faf90107220 con 0x7faf9008d8d0 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient(hunting): dump: 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 >> v1:10.20.193.46:6789/0 conn(0x7faf9008d4d0 legacy=0x7faf9011dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 >> v1:10.20.193.43:6789/0 conn(0x7faf9008ddb0 legacy=0x7faf9018ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3967688000 0 0) 0x7fefe41ab960 con 0x7fefe4057400 2026-02-21T01:27:59.243 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 monclient: found mon.c 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefb0003610 con 0x7fefe4057400 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf90107d80 con 0x7faf9008d8d0 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefd8003030 con 0x7fefe4057400 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 5 monclient: authenticate success, global_id 4325 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 monclient: _renew_subs 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient(hunting): dump: 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.244 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf9005e190 con 0x7faf9008d8d0 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 391849325 0 0) 0x7fefe40878e0 con 0x7fefe4090e20 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 client.4325.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 monclient: _renew_subs 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faf9014c250 con 0x7faf9008d8d0 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 1 librados: init done 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient: monmap: 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.245 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 >> v1:10.20.193.46:6789/0 conn(0x7fefe40901a0 legacy=0x7fefe41a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 >> v1:10.20.193.43:6789/0 conn(0x7fefe4057400 legacy=0x7fefe41ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf78003520 con 0x7faf9008d8d0 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 monclient: found mon.c 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe41a20c0 con 0x7fefe4090e20 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 5 monclient: authenticate success, global_id 4328 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 monclient: _renew_subs 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fefe41a23b0 con 0x7fefe4090e20 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 client.4328.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 monclient: _renew_subs 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fefe4239d30 con 0x7fefe4090e20 2026-02-21T01:27:59.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 1 librados: init done 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7faf78003b50 con 0x7faf9008d8d0 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 10 monclient: dump: 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf8d573640 4 set_mon_vals no callback set 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 librados: starting msgr at 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 librados: starting objecter 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 Processor -- start 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 -- start start 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 librados: setting wanted keys 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefd4003a60 con 0x7fefe4090e20 2026-02-21T01:27:59.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 librados: calling monclient init 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient: init 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefd4003db0 con 0x7fefe4090e20 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 10 monclient: dump: 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe17fa640 4 set_mon_vals no callback set 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9008edd0 con 0x7faf9008d8d0 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient(hunting): picked mon.noname-a con 0x7f1ed40580b0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient(hunting): picked mon.noname-b con 0x7f1ed4058480 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient(hunting): picked mon.noname-c con 0x7f1ed4181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed414cc20 con 0x7f1ed40580b0 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed4149910 con 0x7f1ed4058480 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed412fcf0 con 0x7f1ed4181e80 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1eda3e0640 10 monclient(hunting): authenticate will time out at 610.926759s 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed8956640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f1ed4181e80 0x7f1ed4171cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53586/0 (socket says 10.20.193.43:53586) 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed8956640 1 -- 10.20.193.43:0/1653786328 learned_addr learned my addr 10.20.193.43:0/1653786328 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe40008d0 con 0x7fefe4090e20 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 10 client.?.objecter ms_handle_connect 0x7f1ed4181e80 2026-02-21T01:27:59.249 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7faf78003cf0 con 0x7faf9008d8d0 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899662244 0 0) 0x7f1ed412fcf0 con 0x7f1ed4181e80 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 10 monclient(hunting): my global_id is 4331 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ea4003610 con 0x7f1ed4181e80 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 client.?.objecter ms_handle_connect 0x7f1ed40580b0 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.221+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fefd4010730 con 0x7fefe4090e20 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310469352 0 0) 0x7f1ed414cc20 con 0x7f1ed40580b0 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): my global_id is 4350 2026-02-21T01:27:59.250 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ed412fcf0 con 0x7f1ed40580b0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7faf7804de80 con 0x7faf9008d8d0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7faf6f7fe640 10 client.4325.objecter ms_dispatch2 0x7faf90000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7faf6f7fe640 3 client.4325.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7faf6f7fe640 3 client.4325.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7faf6f7fe640 20 client.4325.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 764867883 0 0) 0x7f1ed412fcf0 con 0x7f1ed40580b0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ed414cc20 con 0x7f1ed40580b0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7fefd404cfc0 con 0x7fefe4090e20 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7fefc37fe640 10 client.4328.objecter ms_dispatch2 0x7fefe4000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7fefc37fe640 3 client.4328.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7fefc37fe640 3 client.4328.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7fefc37fe640 20 client.4328.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1ec00030b0 con 0x7f1ed40580b0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): dump: 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.251 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 client.?.objecter ms_handle_connect 0x7f1ed4058480 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2258429780 0 0) 0x7f1ed414cc20 con 0x7f1ed40580b0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 >> v1:10.20.193.43:6790/0 conn(0x7f1ed4181e80 legacy=0x7f1ed4171cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 >> v1:10.20.193.46:6789/0 conn(0x7f1ed4058480 legacy=0x7f1ed41705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 monclient: found mon.a 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed41302c0 con 0x7f1ed40580b0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7fefe2ffd640 10 monclient: get_auth_request con 0x7fefb003e9a0 auth_method 0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7faf8ed76640 10 monclient: get_auth_request con 0x7faf5c03eab0 auth_method 0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 5 monclient: authenticate success, global_id 4350 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 10 monclient: _renew_subs 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed412e800 con 0x7f1ed40580b0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 10 client.4350.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 10 monclient: _renew_subs 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1ed412f360 con 0x7f1ed40580b0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1eda3e0640 1 librados: init done 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ec00048d0 con 0x7f1ed40580b0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1ec0004ce0 con 0x7f1ed40580b0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed0ff9640 10 monclient: dump: 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7f1ed27fc640 4 set_mon_vals no callback set 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7fefc37fe640 10 client.4328.objecter ms_handle_connect 0x7fefb003e9a0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.222+0000 7faf6f7fe640 10 client.4325.objecter ms_handle_connect 0x7faf5c03eab0 2026-02-21T01:27:59.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1eda3e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1eda3e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1eda3e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed40008d0 con 0x7f1ed40580b0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f1ec0004e80 con 0x7f1ed40580b0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 2943069198 0 0) 0x7f1ec004dc90 con 0x7f1ed40580b0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed0ff9640 10 client.4350.objecter ms_dispatch2 0x7f1ed4000b90 osd_map(19..19 src has 1..19) 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed0ff9640 3 client.4350.objecter handle_osd_map got epochs [19,19] > 0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed0ff9640 3 client.4350.objecter handle_osd_map decoding full epoch 19 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed0ff9640 20 client.4350.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed37fe640 10 monclient: get_auth_request con 0x7f1ea403ea10 auth_method 0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.223+0000 7f1ed0ff9640 10 client.4350.objecter ms_handle_connect 0x7f1ea403ea10 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.224+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7faf78017830 con 0x7faf9008d8d0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.224+0000 7faf6f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.224+0000 7faf6f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.226+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fefe40882a0 con 0x7fefe4090e20 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.226+0000 7fefc37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.226+0000 7fefc37fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.226+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f1ed41302c0 con 0x7f1ed40580b0 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.226+0000 7f1ed0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.226+0000 7f1ed0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.292+0000 7f47e2867640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.292+0000 7f47e2867640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.292+0000 7f47e2867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.292+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f47dc092830 con 0x7f47dc181e80 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.292+0000 7f47d8ff9640 1 -- 10.20.193.43:0/2155495901 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 847495621) 0x7f47d0017ae0 con 0x7f47dc181e80 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.292+0000 7f47d8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.292+0000 7f47d8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:59.294 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fce867fc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fce867fc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fce867fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fceac0008d0 con 0x7fceac05cef0 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fd4a0bac640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fd4a0bac640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fd4a0bac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.293+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd49c054d90 con 0x7fd49c058260 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.294+0000 7fd482ffd640 1 -- 10.20.193.43:0/2197070218 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1444633209) 0x7fd49c12fff0 con 0x7fd49c058260 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.294+0000 7fd482ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.294+0000 7fd482ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.294+0000 7fcea8ff9640 1 -- 10.20.193.43:0/2403144926 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7fce98015c10 con 0x7fceac05cef0 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.294+0000 7fcea8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.294+0000 7fcea8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stdout:47244640260 2026-02-21T01:27:59.295 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 10 librados: watch_flush enter 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 10 librados: watch_flush exit 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 20 client.4307.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 10 client.4307.objecter successfully canceled tick 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 >> v1:10.20.193.46:6812/860801619 conn(0x7f47ac03e9e0 legacy=0x7f47ac05ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 10 monclient: shutdown 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 >> v1:10.20.193.43:6790/0 conn(0x7f47dc181e80 legacy=0x7f47dc171d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 shutdown_connections 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 >> 10.20.193.43:0/2155495901 conn(0x7f47dc090360 msgr2=0x7f47dc08aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 shutdown_connections 2026-02-21T01:27:59.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 1 -- 10.20.193.43:0/2155495901 wait complete. 2026-02-21T01:27:59.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.295+0000 7f47e2867640 1 librados: shutdown 2026-02-21T01:27:59.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 10 librados: watch_flush enter 2026-02-21T01:27:59.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 10 librados: watch_flush exit 2026-02-21T01:27:59.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 20 client.4310.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 10 client.4310.objecter successfully canceled tick 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 10 librados: watch_flush enter 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 10 librados: watch_flush exit 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 >> v1:10.20.193.46:6812/860801619 conn(0x7fd46803e5d0 legacy=0x7fd46805ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 20 client.4332.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 10 client.4332.objecter successfully canceled tick 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 10 monclient: shutdown 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 >> v1:10.20.193.43:6790/0 conn(0x7fd49c058260 legacy=0x7fd49c170280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 >> v1:10.20.193.46:6812/860801619 conn(0x7fce7c03e9d0 legacy=0x7fce7c05ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 10 monclient: shutdown 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 >> v1:10.20.193.43:6789/0 conn(0x7fceac05cef0 legacy=0x7fceac128450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 shutdown_connections 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 >> 10.20.193.43:0/2197070218 conn(0x7fd49c090360 msgr2=0x7fd49c08aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 shutdown_connections 2026-02-21T01:27:59.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 shutdown_connections 2026-02-21T01:27:59.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 >> 10.20.193.43:0/2403144926 conn(0x7fceac08f480 msgr2=0x7fceac08bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 1 -- 10.20.193.43:0/2197070218 wait complete. 2026-02-21T01:27:59.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 shutdown_connections 2026-02-21T01:27:59.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fd4a0bac640 1 librados: shutdown 2026-02-21T01:27:59.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 1 -- 10.20.193.43:0/2403144926 wait complete. 2026-02-21T01:27:59.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.296+0000 7fce867fc640 1 librados: shutdown 2026-02-21T01:27:59.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2026-02-21T01:27:59.306 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:59.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.5 2026-02-21T01:27:59.307 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:59.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.3 2026-02-21T01:27:59.307 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7fefe956f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7fefe956f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7fefe956f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fefe41a31e0 con 0x7fefe4090e20 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7faf9505b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7faf9505b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7faf9505b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faf90054ff0 con 0x7faf9008d8d0 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7fefc37fe640 1 -- 10.20.193.43:0/3781382331 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1444633209) 0x7fefd40169d0 con 0x7fefe4090e20 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7fefc37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-21T01:27:59.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7fefc37fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:59.343 INFO:teuthology.orchestra.run.trial043.stdout:47244640260 2026-02-21T01:27:59.343 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7faf6f7fe640 1 -- 10.20.193.43:0/4258484463 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 847495621) 0x7faf78017130 con 0x7faf9008d8d0 2026-02-21T01:27:59.343 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7faf6f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-21T01:27:59.343 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.340+0000 7faf6f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:59.343 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.342+0000 7fefe956f640 10 librados: watch_flush enter 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.342+0000 7fefe956f640 10 librados: watch_flush exit 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 20 client.4328.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 10 client.4328.objecter successfully canceled tick 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 >> v1:10.20.193.46:6812/860801619 conn(0x7fefb003e9a0 legacy=0x7fefb005ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 10 monclient: shutdown 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 >> v1:10.20.193.43:6790/0 conn(0x7fefe4090e20 legacy=0x7fefe4238430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 shutdown_connections 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 10 librados: watch_flush enter 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 >> 10.20.193.43:0/3781382331 conn(0x7fefe408dd90 msgr2=0x7fefe4085de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 10 librados: watch_flush exit 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 20 client.4325.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 10 client.4325.objecter successfully canceled tick 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 shutdown_connections 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 1 -- 10.20.193.43:0/3781382331 wait complete. 2026-02-21T01:27:59.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 >> v1:10.20.193.46:6812/860801619 conn(0x7faf5c03eab0 legacy=0x7faf5c05ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 10 monclient: shutdown 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 >> v1:10.20.193.43:6790/0 conn(0x7faf9008d8d0 legacy=0x7faf9018d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7fefe956f640 1 librados: shutdown 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 shutdown_connections 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 >> 10.20.193.43:0/4258484463 conn(0x7faf9008f480 msgr2=0x7faf9005c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 shutdown_connections 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7f1eda3e0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-21T01:27:59.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 1 -- 10.20.193.43:0/4258484463 wait complete. 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7f1eda3e0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7f1eda3e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ed412f640 con 0x7f1ed40580b0 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7faf9505b640 1 librados: shutdown 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7f1ed0ff9640 1 -- 10.20.193.43:0/1653786328 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 847495621) 0x7f1ec0017680 con 0x7f1ed40580b0 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7f1ed0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.343+0000 7f1ed0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:59.347 INFO:teuthology.orchestra.run.trial043.stdout:47244640259 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 10 librados: watch_flush enter 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 10 librados: watch_flush exit 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 20 client.4350.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 10 client.4350.objecter successfully canceled tick 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 >> v1:10.20.193.46:6812/860801619 conn(0x7f1ea403ea10 legacy=0x7f1ea405eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 10 monclient: shutdown 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 >> v1:10.20.193.43:6789/0 conn(0x7f1ed40580b0 legacy=0x7f1ed4149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.345+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 shutdown_connections 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.346+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 >> 10.20.193.43:0/1653786328 conn(0x7f1ed4094200 msgr2=0x7f1ed408b300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.346+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 shutdown_connections 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.346+0000 7f1eda3e0640 1 -- 10.20.193.43:0/1653786328 wait complete. 2026-02-21T01:27:59.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.346+0000 7f1eda3e0640 1 librados: shutdown 2026-02-21T01:27:59.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2026-02-21T01:27:59.353 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:59.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.4 2026-02-21T01:27:59.353 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:59.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2026-02-21T01:27:59.355 DEBUG:teuthology.parallel:result is None 2026-02-21T01:27:59.355 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-21T01:27:59.355 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:27:59.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.458+0000 7fc2a5ce8640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.458+0000 7fc2a5ce8640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.458+0000 7fc2a5ce8640 10 monclient: monmap: 2026-02-21T01:27:59.469 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.469 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.469 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.459155+0000 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.459155+0000 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 1 Processor -- start 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 1 -- start start 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient: init 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:59.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient(hunting): picked mon.noname-a con 0x7fc2a008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient(hunting): picked mon.noname-b con 0x7fc2a008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient(hunting): picked mon.noname-c con 0x7fc2a008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a008a690 con 0x7fc2a008ddb0 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a008b910 con 0x7fc2a008d8d0 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a0088ae0 con 0x7fc2a008d4d0 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc2a5ce8640 10 monclient(hunting): authenticate will time out at 611.164634s 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29f7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc2a008ddb0 0x7fc2a008e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36492/0 (socket says 10.20.193.43:36492) 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29f7fe640 1 -- 10.20.193.43:0/2214520269 learned_addr learned my addr 10.20.193.43:0/2214520269 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796266365 0 0) 0x7fc2a008a690 con 0x7fc2a008ddb0 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): my global_id is 4353 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc284003610 con 0x7fc2a008ddb0 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871302795 0 0) 0x7fc2a0088ae0 con 0x7fc2a008d4d0 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 10 monclient(hunting): my global_id is 4334 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.459+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2a008a690 con 0x7fc2a008d4d0 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1308631181 0 0) 0x7fc284003610 con 0x7fc2a008ddb0 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 >> v1:10.20.193.43:6790/0 conn(0x7fc2a008d4d0 legacy=0x7fc2a017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 >> v1:10.20.193.46:6789/0 conn(0x7fc2a008d8d0 legacy=0x7fc2a019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 monclient: found mon.noname-a 2026-02-21T01:27:59.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a01a3ef0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc28c002df0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: dump: 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.473 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 5 monclient: authenticate success, global_id 4353 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc28c003030 con 0x7fc2a008ddb0 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 1 -- 10.20.193.43:0/2214520269 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc28c003470 con 0x7fc2a008ddb0 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc29e7fc640 10 monclient: dump: 2026-02-21T01:27:59.474 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 4 set_mon_vals no callback set 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 10 monclient: shutdown 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/2214520269 >> v1:10.20.193.43:6789/0 conn(0x7fc2a008ddb0 legacy=0x7fc2a008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/2214520269 shutdown_connections 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/2214520269 >> 10.20.193.43:0/2214520269 conn(0x7fc2a008f480 msgr2=0x7fc2a008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/2214520269 shutdown_connections 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/2214520269 wait complete. 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 10 monclient: monmap: 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.476 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 1 librados: starting msgr at 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.460+0000 7fc2a5ce8640 1 librados: starting objecter 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 Processor -- start 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 -- start start 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 librados: setting wanted keys 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 librados: calling monclient init 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient: init 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient(hunting): picked mon.noname-b con 0x7fc2a008d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient(hunting): picked mon.noname-a con 0x7fc2a008d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient(hunting): picked mon.noname-c con 0x7fc2a008ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a010a450 con 0x7fc2a008d8d0 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a005e1b0 con 0x7fc2a008d4d0 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a01080f0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient(hunting): authenticate will time out at 611.166400s 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc29effd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc2a008d8d0 0x7fc2a018b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36508/0 (socket says 10.20.193.43:36508) 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc29effd640 1 -- 10.20.193.43:0/3981361696 learned_addr learned my addr 10.20.193.43:0/3981361696 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 client.?.objecter ms_handle_connect 0x7fc2a008ddb0 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 client.?.objecter ms_handle_connect 0x7fc2a008d8d0 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035662141 0 0) 0x7fc2a01080f0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): my global_id is 4337 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc270003610 con 0x7fc2a008ddb0 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882772145 0 0) 0x7fc2a010a450 con 0x7fc2a008d8d0 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): my global_id is 4356 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2a01080f0 con 0x7fc2a008d8d0 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 client.?.objecter ms_handle_connect 0x7fc2a008d4d0 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 181386589 0 0) 0x7fc270003610 con 0x7fc2a008ddb0 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2a010a450 con 0x7fc2a008ddb0 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc294003390 con 0x7fc2a008ddb0 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): dump: 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.480 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1011137269 0 0) 0x7fc2a01080f0 con 0x7fc2a008d8d0 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc270003610 con 0x7fc2a008d8d0 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc2900030a0 con 0x7fc2a008d8d0 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): dump: 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.481 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832129689 0 0) 0x7fc2a005e1b0 con 0x7fc2a008d4d0 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient(hunting): my global_id is 4294 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2a01080f0 con 0x7fc2a008d4d0 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3104413676 0 0) 0x7fc2a010a450 con 0x7fc2a008ddb0 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 >> v1:10.20.193.46:6789/0 conn(0x7fc2a008d4d0 legacy=0x7fc2a011eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 >> v1:10.20.193.43:6789/0 conn(0x7fc2a008d8d0 legacy=0x7fc2a018b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 monclient: found mon.c 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a0109bb0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 5 monclient: authenticate success, global_id 4337 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient: _renew_subs 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a0109ef0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 client.4337.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient: _renew_subs 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc2a0107860 con 0x7fc2a008ddb0 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc2a5ce8640 1 librados: init done 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc2940039f0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc294003d80 con 0x7fc2a008ddb0 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc29dffb640 4 set_mon_vals no callback set 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.461+0000 7fc27bfff640 10 monclient: dump: 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.484 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc2a5ce8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc2a5ce8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc2a5ce8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a008edb0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fc294003f20 con 0x7fc2a008ddb0 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7fc29404cde0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc27bfff640 10 client.4337.objecter ms_dispatch2 0x7fc2a0000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:27:59.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc27bfff640 3 client.4337.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:27:59.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc27bfff640 3 client.4337.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:27:59.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc27bfff640 20 client.4337.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc29f7fe640 10 monclient: get_auth_request con 0x7fc27003eb40 auth_method 0 2026-02-21T01:27:59.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.462+0000 7fc27bfff640 10 client.4337.objecter ms_handle_connect 0x7fc27003eb40 2026-02-21T01:27:59.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.464+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc2a0109ef0 con 0x7fc2a008ddb0 2026-02-21T01:27:59.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.464+0000 7fc27bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.464+0000 7fc27bfff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.573 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.572+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2a0054ff0 con 0x7fc27003eb40 2026-02-21T01:27:59.574 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.572+0000 7fc27bfff640 1 -- 10.20.193.43:0/3981361696 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 2237603573) 0x7fc2a0054ff0 con 0x7fc27003eb40 2026-02-21T01:27:59.575 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:59.576 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 10 librados: watch_flush enter 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 10 librados: watch_flush exit 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 20 client.4337.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 10 client.4337.objecter successfully canceled tick 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 >> v1:10.20.193.46:6812/860801619 conn(0x7fc27003eb40 legacy=0x7fc27005eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 10 monclient: shutdown 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 >> v1:10.20.193.43:6790/0 conn(0x7fc2a008ddb0 legacy=0x7fc2a018cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 shutdown_connections 2026-02-21T01:27:59.577 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 >> 10.20.193.43:0/3981361696 conn(0x7fc2a008f480 msgr2=0x7fc2a01a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.578 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 shutdown_connections 2026-02-21T01:27:59.578 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 1 -- 10.20.193.43:0/3981361696 wait complete. 2026-02-21T01:27:59.578 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.573+0000 7fc2a5ce8640 1 librados: shutdown 2026-02-21T01:27:59.583 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-21T01:27:59.374807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163768,"kb_used_data":2008,"kb_used_omap":53,"kb_used_meta":161610,"kb_avail":566067272,"statfs":{"total":579820584960,"available":579652886528,"internally_reserved":0,"allocated":2056192,"data_stored":1370530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54597,"internal_metadata":165489339},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.761114"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910464+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:27:56.910464+0000","last_peered":"2026-02-21T01:27:56.910464+0000","last_clean":"2026-02-21T01:27:56.910464+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:27:56.910464+0000","last_undegraded":"2026-02-21T01:27:56.910464+0000","last_fullsized":"2026-02-21T01:27:56.910464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809979+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:27:56.809979+0000","last_peered":"2026-02-21T01:27:56.809979+0000","last_clean":"2026-02-21T01:27:56.809979+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:27:56.809979+0000","last_undegraded":"2026-02-21T01:27:56.809979+0000","last_fullsized":"2026-02-21T01:27:56.809979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910390+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:27:56.910390+0000","last_peered":"2026-02-21T01:27:56.910390+0000","last_clean":"2026-02-21T01:27:56.910390+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:27:56.910390+0000","last_undegraded":"2026-02-21T01:27:56.910390+0000","last_fullsized":"2026-02-21T01:27:56.910390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.810259+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:27:56.810259+0000","last_peered":"2026-02-21T01:27:56.810259+0000","last_clean":"2026-02-21T01:27:56.810259+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:27:56.810259+0000","last_undegraded":"2026-02-21T01:27:56.810259+0000","last_fullsized":"2026-02-21T01:27:56.810259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.812512+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:27:56.812512+0000","last_peered":"2026-02-21T01:27:56.812512+0000","last_clean":"2026-02-21T01:27:56.812512+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:27:56.812512+0000","last_undegraded":"2026-02-21T01:27:56.812512+0000","last_fullsized":"2026-02-21T01:27:56.812512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809832+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:27:56.809832+0000","last_peered":"2026-02-21T01:27:56.809832+0000","last_clean":"2026-02-21T01:27:56.809832+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:27:56.809832+0000","last_undegraded":"2026-02-21T01:27:56.809832+0000","last_fullsized":"2026-02-21T01:27:56.809832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910246+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:27:56.910246+0000","last_peered":"2026-02-21T01:27:56.910246+0000","last_clean":"2026-02-21T01:27:56.910246+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:27:56.910246+0000","last_undegraded":"2026-02-21T01:27:56.910246+0000","last_fullsized":"2026-02-21T01:27:56.910246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.811979+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:27:56.811979+0000","last_peered":"2026-02-21T01:27:56.811979+0000","last_clean":"2026-02-21T01:27:56.811979+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:27:56.811979+0000","last_undegraded":"2026-02-21T01:27:56.811979+0000","last_fullsized":"2026-02-21T01:27:56.811979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.909753+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:27:56.909753+0000","last_peered":"2026-02-21T01:27:56.909753+0000","last_clean":"2026-02-21T01:27:56.909753+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:27:56.909753+0000","last_undegraded":"2026-02-21T01:27:56.909753+0000","last_fullsized":"2026-02-21T01:27:56.909753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:27:59.585 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:27:59.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient: monmap: 2026-02-21T01:27:59.651 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.651 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.651 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.650498+0000 2026-02-21T01:27:59.652 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.650498+0000 2026-02-21T01:27:59.652 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.652 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.652 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.652 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.652 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.652 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 1 Processor -- start 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 1 -- start start 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient: init 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient(hunting): picked mon.noname-a con 0x7f4fc008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient(hunting): picked mon.noname-b con 0x7f4fc008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient(hunting): picked mon.noname-c con 0x7f4fc008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc008a690 con 0x7f4fc008ddb0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc008b910 con 0x7f4fc008d8d0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc0088ae0 con 0x7f4fc008d4d0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc7804640 10 monclient(hunting): authenticate will time out at 611.355919s 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc5579640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f4fc008ddb0 0x7f4fc008e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36518/0 (socket says 10.20.193.43:36518) 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.650+0000 7f4fc5579640 1 -- 10.20.193.43:0/4080692237 learned_addr learned my addr 10.20.193.43:0/4080692237 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803461676 0 0) 0x7f4fc008a690 con 0x7f4fc008ddb0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): my global_id is 4359 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa8003610 con 0x7f4fc008ddb0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231791983 0 0) 0x7f4fc0088ae0 con 0x7f4fc008d4d0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): my global_id is 4340 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc008a690 con 0x7f4fc008d4d0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861333145 0 0) 0x7f4fc008b910 con 0x7f4fc008d8d0 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient(hunting): my global_id is 4297 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc0088ae0 con 0x7f4fc008d8d0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2001022283 0 0) 0x7f4fa8003610 con 0x7f4fc008ddb0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 >> v1:10.20.193.43:6790/0 conn(0x7f4fc008d4d0 legacy=0x7f4fc017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 >> v1:10.20.193.46:6789/0 conn(0x7f4fc008d8d0 legacy=0x7f4fc019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 monclient: found mon.noname-a 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc01a3ef0 con 0x7f4fc008ddb0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4fb0002df0 con 0x7f4fc008ddb0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: dump: 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 5 monclient: authenticate success, global_id 4359 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fb0003000 con 0x7f4fc008ddb0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 1 -- 10.20.193.43:0/4080692237 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4fb0003440 con 0x7f4fc008ddb0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4faffff640 10 monclient: dump: 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.654 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 4 set_mon_vals no callback set 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 10 monclient: shutdown 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 1 -- 10.20.193.43:0/4080692237 >> v1:10.20.193.43:6789/0 conn(0x7f4fc008ddb0 legacy=0x7f4fc008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 1 -- 10.20.193.43:0/4080692237 shutdown_connections 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 1 -- 10.20.193.43:0/4080692237 >> 10.20.193.43:0/4080692237 conn(0x7f4fc008f480 msgr2=0x7f4fc008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 1 -- 10.20.193.43:0/4080692237 shutdown_connections 2026-02-21T01:27:59.655 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.651+0000 7f4fc7804640 1 -- 10.20.193.43:0/4080692237 wait complete. 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: monmap: 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.656 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 librados: starting msgr at 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 librados: starting objecter 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 Processor -- start 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 -- start start 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 librados: setting wanted keys 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 librados: calling monclient init 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: init 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient(hunting): picked mon.noname-a con 0x7f4fc008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient(hunting): picked mon.noname-c con 0x7f4fc008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient(hunting): picked mon.noname-b con 0x7f4fc008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc0109340 con 0x7f4fc008d4d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc0056fc0 con 0x7f4fc008ddb0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc0109060 con 0x7f4fc008d8d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient(hunting): authenticate will time out at 611.357573s 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc5579640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f4fc008d4d0 0x7f4fc011dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36522/0 (socket says 10.20.193.43:36522) 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc5579640 1 -- 10.20.193.43:0/3161768772 learned_addr learned my addr 10.20.193.43:0/3161768772 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 client.?.objecter ms_handle_connect 0x7f4fc008d4d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 client.?.objecter ms_handle_connect 0x7f4fc008d8d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535386538 0 0) 0x7f4fc0109340 con 0x7f4fc008d4d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): my global_id is 4362 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f90003610 con 0x7f4fc008d4d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322980343 0 0) 0x7f4fc0109060 con 0x7f4fc008d8d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): my global_id is 4343 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc0109340 con 0x7f4fc008d8d0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 client.?.objecter ms_handle_connect 0x7f4fc008ddb0 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4197499769 0 0) 0x7f4f90003610 con 0x7f4fc008d4d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fc0109060 con 0x7f4fc008d4d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4fb0003350 con 0x7f4fc008d4d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): dump: 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3664817718 0 0) 0x7f4fc0109340 con 0x7f4fc008d8d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f90003610 con 0x7f4fc008d8d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4fb40031c0 con 0x7f4fc008d8d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient(hunting): dump: 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1602405112 0 0) 0x7f4fc0109060 con 0x7f4fc008d4d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 >> v1:10.20.193.43:6790/0 conn(0x7f4fc008d8d0 legacy=0x7f4fc018d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 >> v1:10.20.193.46:6789/0 conn(0x7f4fc008ddb0 legacy=0x7f4fc018ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 monclient: found mon.a 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc011e390 con 0x7f4fc008d4d0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.658 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 5 monclient: authenticate success, global_id 4362 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: _renew_subs 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc0107e20 con 0x7f4fc008d4d0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: _renew_subs 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fc014c5e0 con 0x7f4fc008d4d0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fc7804640 1 librados: init done 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fb0004ce0 con 0x7f4fc008d4d0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4fb0005030 con 0x7f4fc008d4d0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4fadffb640 10 monclient: dump: 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.652+0000 7f4faf7fe640 4 set_mon_vals no callback set 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f4fb00119b0 con 0x7f4fc008d4d0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fc7804640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fc7804640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fc7804640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc005e190 con 0x7f4fc008d4d0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f4fb004dca0 con 0x7f4fc008d4d0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fadffb640 10 client.4362.objecter ms_dispatch2 0x7f4fc0000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fadffb640 3 client.4362.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fadffb640 3 client.4362.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fadffb640 20 client.4362.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.653+0000 7f4fc4d78640 10 monclient: get_auth_request con 0x7f4f9003e950 auth_method 0 2026-02-21T01:27:59.659 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.654+0000 7f4fadffb640 10 client.4362.objecter ms_handle_connect 0x7f4f9003e950 2026-02-21T01:27:59.660 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.655+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4fb0017730 con 0x7f4fc008d4d0 2026-02-21T01:27:59.660 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.655+0000 7f4fadffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.660 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.655+0000 7f4fadffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.761+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fc00573f0 con 0x7f4f9003e950 2026-02-21T01:27:59.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fadffb640 1 -- 10.20.193.43:0/3161768772 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 2237603573) 0x7f4fb40048c0 con 0x7f4f9003e950 2026-02-21T01:27:59.763 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:59.763 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 10 librados: watch_flush enter 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 10 librados: watch_flush exit 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 20 client.4362.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 10 client.4362.objecter successfully canceled tick 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 >> v1:10.20.193.46:6812/860801619 conn(0x7f4f9003e950 legacy=0x7f4f9005ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 10 monclient: shutdown 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 >> v1:10.20.193.43:6789/0 conn(0x7f4fc008d4d0 legacy=0x7f4fc011dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 shutdown_connections 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 >> 10.20.193.43:0/3161768772 conn(0x7f4fc008f480 msgr2=0x7f4fc01a2710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.762+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 shutdown_connections 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.763+0000 7f4fc7804640 1 -- 10.20.193.43:0/3161768772 wait complete. 2026-02-21T01:27:59.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.763+0000 7f4fc7804640 1 librados: shutdown 2026-02-21T01:27:59.772 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-21T01:27:59.374807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163768,"kb_used_data":2008,"kb_used_omap":53,"kb_used_meta":161610,"kb_avail":566067272,"statfs":{"total":579820584960,"available":579652886528,"internally_reserved":0,"allocated":2056192,"data_stored":1370530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54597,"internal_metadata":165489339},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.761114"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910464+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:27:56.910464+0000","last_peered":"2026-02-21T01:27:56.910464+0000","last_clean":"2026-02-21T01:27:56.910464+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:27:56.910464+0000","last_undegraded":"2026-02-21T01:27:56.910464+0000","last_fullsized":"2026-02-21T01:27:56.910464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809979+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:27:56.809979+0000","last_peered":"2026-02-21T01:27:56.809979+0000","last_clean":"2026-02-21T01:27:56.809979+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:27:56.809979+0000","last_undegraded":"2026-02-21T01:27:56.809979+0000","last_fullsized":"2026-02-21T01:27:56.809979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910390+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:27:56.910390+0000","last_peered":"2026-02-21T01:27:56.910390+0000","last_clean":"2026-02-21T01:27:56.910390+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:27:56.910390+0000","last_undegraded":"2026-02-21T01:27:56.910390+0000","last_fullsized":"2026-02-21T01:27:56.910390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.810259+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:27:56.810259+0000","last_peered":"2026-02-21T01:27:56.810259+0000","last_clean":"2026-02-21T01:27:56.810259+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:27:56.810259+0000","last_undegraded":"2026-02-21T01:27:56.810259+0000","last_fullsized":"2026-02-21T01:27:56.810259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.812512+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:27:56.812512+0000","last_peered":"2026-02-21T01:27:56.812512+0000","last_clean":"2026-02-21T01:27:56.812512+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:27:56.812512+0000","last_undegraded":"2026-02-21T01:27:56.812512+0000","last_fullsized":"2026-02-21T01:27:56.812512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809832+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:27:56.809832+0000","last_peered":"2026-02-21T01:27:56.809832+0000","last_clean":"2026-02-21T01:27:56.809832+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:27:56.809832+0000","last_undegraded":"2026-02-21T01:27:56.809832+0000","last_fullsized":"2026-02-21T01:27:56.809832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910246+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:27:56.910246+0000","last_peered":"2026-02-21T01:27:56.910246+0000","last_clean":"2026-02-21T01:27:56.910246+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:27:56.910246+0000","last_undegraded":"2026-02-21T01:27:56.910246+0000","last_fullsized":"2026-02-21T01:27:56.910246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.811979+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:27:56.811979+0000","last_peered":"2026-02-21T01:27:56.811979+0000","last_clean":"2026-02-21T01:27:56.811979+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:27:56.811979+0000","last_undegraded":"2026-02-21T01:27:56.811979+0000","last_fullsized":"2026-02-21T01:27:56.811979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.909753+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:27:56.909753+0000","last_peered":"2026-02-21T01:27:56.909753+0000","last_clean":"2026-02-21T01:27:56.909753+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:27:56.909753+0000","last_undegraded":"2026-02-21T01:27:56.909753+0000","last_fullsized":"2026-02-21T01:27:56.909753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:27:59.774 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-21T01:27:59.774 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-21T01:27:59.774 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-21T01:27:59.774 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-21T01:27:59.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient: get_monmap_and_config 2026-02-21T01:27:59.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.852 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient: monmap: 2026-02-21T01:27:59.852 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.852 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.852 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:59.841489+0000 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:59.841489+0000 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.853 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 1 Processor -- start 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 1 -- start start 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient: init 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient(hunting): picked mon.noname-b con 0x7f534408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient(hunting): picked mon.noname-c con 0x7f534408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient(hunting): picked mon.noname-a con 0x7f534408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534408a690 con 0x7f534408d8d0 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534408b910 con 0x7f534408d4d0 2026-02-21T01:27:59.854 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5344088ae0 con 0x7f534408ddb0 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f5349ded640 10 monclient(hunting): authenticate will time out at 611.546941s 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.841+0000 7f53437fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f534408ddb0 0x7f534408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53626/0 (socket says 10.20.193.43:53626) 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53437fe640 1 -- 10.20.193.43:0/3483343195 learned_addr learned my addr 10.20.193.43:0/3483343195 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229243163 0 0) 0x7f5344088ae0 con 0x7f534408ddb0 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.855 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): my global_id is 4346 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5328003610 con 0x7f534408ddb0 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468411079 0 0) 0x7f534408a690 con 0x7f534408d8d0 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): my global_id is 4365 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5344088ae0 con 0x7f534408d8d0 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317425027 0 0) 0x7f534408b910 con 0x7f534408d4d0 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.856 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient(hunting): my global_id is 4303 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f534408a690 con 0x7f534408d4d0 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3485573259 0 0) 0x7f5328003610 con 0x7f534408ddb0 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 >> v1:10.20.193.46:6789/0 conn(0x7f534408d4d0 legacy=0x7f534417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 >> v1:10.20.193.43:6789/0 conn(0x7f534408d8d0 legacy=0x7f534419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 monclient: found mon.noname-b 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53441a3ef0 con 0x7f534408ddb0 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.857 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5330002d20 con 0x7f534408ddb0 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: dump: 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.858 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 5 monclient: authenticate success, global_id 4346 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5330002f30 con 0x7f534408ddb0 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 1 -- 10.20.193.43:0/3483343195 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5330003370 con 0x7f534408ddb0 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f53427fc640 10 monclient: dump: 2026-02-21T01:27:59.859 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 10 monclient: get_monmap_and_config success 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 4 set_mon_vals no callback set 2026-02-21T01:27:59.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 10 monclient: shutdown 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 1 -- 10.20.193.43:0/3483343195 >> v1:10.20.193.43:6790/0 conn(0x7f534408ddb0 legacy=0x7f534408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 1 -- 10.20.193.43:0/3483343195 shutdown_connections 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 1 -- 10.20.193.43:0/3483343195 >> 10.20.193.43:0/3483343195 conn(0x7f534408f480 msgr2=0x7f534408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 1 -- 10.20.193.43:0/3483343195 shutdown_connections 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.842+0000 7f5349ded640 1 -- 10.20.193.43:0/3483343195 wait complete. 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient: build_initial_monmap 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient: monmap: 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:27:59.861 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 librados: starting msgr at 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 librados: starting objecter 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 Processor -- start 2026-02-21T01:27:59.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 -- start start 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 librados: setting wanted keys 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 librados: calling monclient init 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient: init 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient: _reopen_session rank -1 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient(hunting): picked mon.noname-b con 0x7f534408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient(hunting): picked mon.noname-c con 0x7f534408d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:27:59.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient(hunting): picked mon.noname-a con 0x7f534408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534405cfc0 con 0x7f534408ddb0 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534405e1b0 con 0x7f534408d4d0 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5344125bd0 con 0x7f534408d8d0 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient(hunting): _renew_subs 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5349ded640 10 monclient(hunting): authenticate will time out at 611.548817s 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5342ffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f534408d8d0 0x7f5344124b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53638/0 (socket says 10.20.193.43:53638) 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5343fff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f534408ddb0 0x7f534419b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36550/0 (socket says 10.20.193.43:36550) 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f5342ffd640 1 -- 10.20.193.43:0/1278562256 learned_addr learned my addr 10.20.193.43:0/1278562256 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 client.?.objecter ms_handle_connect 0x7f534408d8d0 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.864 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 client.?.objecter ms_handle_connect 0x7f534408ddb0 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913882806 0 0) 0x7f5344125bd0 con 0x7f534408d8d0 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): my global_id is 4349 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5314003610 con 0x7f534408d8d0 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435268642 0 0) 0x7f534405cfc0 con 0x7f534408ddb0 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:27:59.865 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 10 monclient(hunting): my global_id is 4368 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.843+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5344125bd0 con 0x7f534408ddb0 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 client.?.objecter ms_handle_connect 0x7f534408d4d0 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3863853983 0 0) 0x7f5314003610 con 0x7f534408d8d0 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f534405cfc0 con 0x7f534408d8d0 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5334003170 con 0x7f534408d8d0 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient(hunting): dump: 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.866 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 376466795 0 0) 0x7f5344125bd0 con 0x7f534408ddb0 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5314003610 con 0x7f534408ddb0 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5338003580 con 0x7f534408ddb0 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:27:59.867 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient(hunting): dump: 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.868 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3915740333 0 0) 0x7f534405cfc0 con 0x7f534408d8d0 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 >> v1:10.20.193.46:6789/0 conn(0x7f534408d4d0 legacy=0x7f5344124420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 >> v1:10.20.193.43:6789/0 conn(0x7f534408ddb0 legacy=0x7f534419b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: _finish_hunting 0 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 monclient: found mon.c 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.869 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5344127f30 con 0x7f534408d8d0 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: _finish_auth 0 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: _check_auth_tickets 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 5 monclient: authenticate success, global_id 4349 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 monclient: _renew_subs 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5344126730 con 0x7f534408d8d0 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 client.4349.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 monclient: _renew_subs 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5344125240 con 0x7f534408d8d0 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 1 librados: init done 2026-02-21T01:27:59.870 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5334003520 con 0x7f534408d8d0 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5334003b50 con 0x7f534408d8d0 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 monclient: dump: 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:27:59.871 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5341ffb640 4 set_mon_vals no callback set 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f5334003cf0 con 0x7f534408d8d0 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f534408edd0 con 0x7f534408d8d0 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f533404dd40 con 0x7f534408d8d0 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 10 client.4349.objecter ms_dispatch2 0x7f5344000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 3 client.4349.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 3 client.4349.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.844+0000 7f531ffff640 20 client.4349.objecter dump_active .. 0 homeless 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.845+0000 7f53437fe640 10 monclient: get_auth_request con 0x7f531403e930 auth_method 0 2026-02-21T01:27:59.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.845+0000 7f531ffff640 10 client.4349.objecter ms_handle_connect 0x7f531403e930 2026-02-21T01:27:59.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.846+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f53340898b0 con 0x7f534408d8d0 2026-02-21T01:27:59.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.846+0000 7f531ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:27:59.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.846+0000 7f531ffff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:27:59.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.982+0000 7f5349ded640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-21T01:27:59.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.982+0000 7f5349ded640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-21T01:27:59.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.982+0000 7f5349ded640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:27:59.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.982+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f53441278d0 con 0x7f534408d8d0 2026-02-21T01:27:59.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.982+0000 7f531ffff640 1 -- 10.20.193.43:0/1278562256 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f5334017710 con 0x7f534408d8d0 2026-02-21T01:27:59.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.982+0000 7f531ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-21T01:27:59.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.982+0000 7f531ffff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:27:59.985 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:27:59.985 INFO:teuthology.orchestra.run.trial043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-21T01:27:59.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 10 librados: watch_flush enter 2026-02-21T01:27:59.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 10 librados: watch_flush exit 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 20 client.4349.objecter shutdown clearing up homeless session... 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 10 client.4349.objecter successfully canceled tick 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 >> v1:10.20.193.46:6812/860801619 conn(0x7f531403e930 legacy=0x7f531405ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 10 monclient: shutdown 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 >> v1:10.20.193.43:6790/0 conn(0x7f534408d8d0 legacy=0x7f5344124b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 shutdown_connections 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 >> 10.20.193.43:0/1278562256 conn(0x7f534408f480 msgr2=0x7f53441a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 shutdown_connections 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 1 -- 10.20.193.43:0/1278562256 wait complete. 2026-02-21T01:27:59.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:27:59.983+0000 7f5349ded640 1 librados: shutdown 2026-02-21T01:27:59.994 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-21T01:27:59.994 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-21T01:28:00.026 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-21T01:28:00.027 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-21T01:28:00.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient: get_monmap_and_config 2026-02-21T01:28:00.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient: monmap: 2026-02-21T01:28:00.101 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.101 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:00.092490+0000 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:00.092490+0000 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 1 Processor -- start 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 1 -- start start 2026-02-21T01:28:00.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient: init 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient(hunting): picked mon.noname-c con 0x7f0c9808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient(hunting): picked mon.noname-b con 0x7f0c9808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient(hunting): picked mon.noname-a con 0x7f0c9808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9808a690 con 0x7f0c9808d8d0 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9808b910 con 0x7f0c9808ddb0 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c98088ae0 con 0x7f0c9808d4d0 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c9d5e3640 10 monclient(hunting): authenticate will time out at 611.797892s 2026-02-21T01:28:00.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c977fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f0c9808d8d0 0x7f0c9819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36560/0 (socket says 10.20.193.43:36560) 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c967fc640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f0c9808d4d0 0x7f0c9817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53642/0 (socket says 10.20.193.43:53642) 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.092+0000 7f0c977fe640 1 -- 10.20.193.43:0/340739974 learned_addr learned my addr 10.20.193.43:0/340739974 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458466217 0 0) 0x7f0c9808a690 con 0x7f0c9808d8d0 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): my global_id is 4371 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c84003610 con 0x7f0c9808d8d0 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782973140 0 0) 0x7f0c98088ae0 con 0x7f0c9808d4d0 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient(hunting): my global_id is 4352 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c9808a690 con 0x7f0c9808d4d0 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2644834115 0 0) 0x7f0c84003610 con 0x7f0c9808d8d0 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 >> v1:10.20.193.43:6790/0 conn(0x7f0c9808d4d0 legacy=0x7f0c9817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 >> v1:10.20.193.46:6789/0 conn(0x7f0c9808ddb0 legacy=0x7f0c9808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 monclient: found mon.noname-a 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c981a3ef0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0c88003170 con 0x7f0c9808d8d0 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: dump: 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.106 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 5 monclient: authenticate success, global_id 4371 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c880033b0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 1 -- 10.20.193.43:0/340739974 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0c880037f0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c95ffb640 10 monclient: dump: 2026-02-21T01:28:00.107 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 4 set_mon_vals no callback set 2026-02-21T01:28:00.108 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 10 monclient: shutdown 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/340739974 >> v1:10.20.193.43:6789/0 conn(0x7f0c9808d8d0 legacy=0x7f0c9819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/340739974 shutdown_connections 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/340739974 >> 10.20.193.43:0/340739974 conn(0x7f0c9808f480 msgr2=0x7f0c9808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/340739974 shutdown_connections 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.093+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/340739974 wait complete. 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: monmap: 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:00.109 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 librados: starting msgr at 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 librados: starting objecter 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 Processor -- start 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 -- start start 2026-02-21T01:28:00.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 librados: setting wanted keys 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 librados: calling monclient init 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: init 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient(hunting): picked mon.noname-b con 0x7f0c9808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient(hunting): picked mon.noname-c con 0x7f0c9808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient(hunting): picked mon.noname-a con 0x7f0c9808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c98108ff0 con 0x7f0c9808ddb0 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c981092d0 con 0x7f0c9808d4d0 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c98106710 con 0x7f0c9808d8d0 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.111 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient(hunting): authenticate will time out at 611.799475s 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c967fc640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f0c9808d8d0 0x7f0c98106000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53646/0 (socket says 10.20.193.43:53646) 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c967fc640 1 -- 10.20.193.43:0/2706951962 learned_addr learned my addr 10.20.193.43:0/2706951962 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 client.?.objecter ms_handle_connect 0x7f0c9808ddb0 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 client.?.objecter ms_handle_connect 0x7f0c9808d8d0 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990245298 0 0) 0x7f0c98106710 con 0x7f0c9808d8d0 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): my global_id is 4355 2026-02-21T01:28:00.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c64003610 con 0x7f0c9808d8d0 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049501717 0 0) 0x7f0c98108ff0 con 0x7f0c9808ddb0 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): my global_id is 4374 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c98106710 con 0x7f0c9808ddb0 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1828504880 0 0) 0x7f0c64003610 con 0x7f0c9808d8d0 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c98108ff0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0c800031c0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:28:00.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): dump: 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:00.114 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1437739592 0 0) 0x7f0c98106710 con 0x7f0c9808ddb0 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c64003610 con 0x7f0c9808ddb0 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0c88003560 con 0x7f0c9808ddb0 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient(hunting): dump: 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.115 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2568202716 0 0) 0x7f0c98108ff0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 >> v1:10.20.193.46:6789/0 conn(0x7f0c9808d4d0 legacy=0x7f0c981058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 >> v1:10.20.193.43:6789/0 conn(0x7f0c9808ddb0 legacy=0x7f0c9819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 monclient: found mon.c 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c98107db0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 5 monclient: authenticate success, global_id 4355 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: _renew_subs 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c981074b0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 client.4355.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: _renew_subs 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c9812a2b0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c9d5e3640 1 librados: init done 2026-02-21T01:28:00.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c80003470 con 0x7f0c9808d8d0 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0c80004d20 con 0x7f0c9808d8d0 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c777fe640 10 monclient: dump: 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.118 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.094+0000 7f0c957fa640 4 set_mon_vals no callback set 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c9d5e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c9d5e3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c9d5e3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9808edd0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f0c800116a0 con 0x7f0c9808d8d0 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f0c8004dd30 con 0x7f0c9808d8d0 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c777fe640 10 client.4355.objecter ms_dispatch2 0x7f0c98000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c777fe640 3 client.4355.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:00.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c777fe640 3 client.4355.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:00.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c777fe640 20 client.4355.objecter dump_active .. 0 homeless 2026-02-21T01:28:00.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.095+0000 7f0c96ffd640 10 monclient: get_auth_request con 0x7f0c6403e9d0 auth_method 0 2026-02-21T01:28:00.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.096+0000 7f0c777fe640 10 client.4355.objecter ms_handle_connect 0x7f0c6403e9d0 2026-02-21T01:28:00.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.097+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f0c80017760 con 0x7f0c9808d8d0 2026-02-21T01:28:00.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.097+0000 7f0c777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.097+0000 7f0c777fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:00.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.206+0000 7f0c9d5e3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.206+0000 7f0c9d5e3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.206+0000 7f0c9d5e3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.206+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c98109610 con 0x7f0c9808d8d0 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.206+0000 7f0c777fe640 1 -- 10.20.193.43:0/2706951962 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10942 (unknown 3413328019 0 3040491984) 0x7f0c80017060 con 0x7f0c9808d8d0 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.206+0000 7f0c777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.206+0000 7f0c777fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:28:00.208 INFO:teuthology.orchestra.run.trial043.stdout:{"epoch":20,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","created":"2026-02-21T01:27:44.582175+0000","modified":"2026-02-21T01:27:59.373256+0000","last_up_change":"2026-02-21T01:27:48.746376+0000","last_in_change":"2026-02-21T01:27:45.744393+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-21T01:27:50.628015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-21T01:27:53.551352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e67289af-bac2-443d-83b5-4766298e9303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6800","nonce":1072173340}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6801","nonce":1072173340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6803","nonce":1072173340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6802","nonce":1072173340}]},"public_addr":"10.20.193.43:6800/1072173340","cluster_addr":"10.20.193.43:6801/1072173340","heartbeat_back_addr":"10.20.193.43:6803/1072173340","heartbeat_front_addr":"10.20.193.43:6802/1072173340","state":["exists","up"]},{"osd":1,"uuid":"4207f5e8-3ce8-4f55-bb23-a8605d56d872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6808","nonce":3522371706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6809","nonce":3522371706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6811","nonce":3522371706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6810","nonce":3522371706}]},"public_addr":"10.20.193.43:6808/3522371706","cluster_addr":"10.20.193.43:6809/3522371706","heartbeat_back_addr":"10.20.193.43:6811/3522371706","heartbeat_front_addr":"10.20.193.43:6810/3522371706","state":["exists","up"]},{"osd":2,"uuid":"da0c4995-e8bf-480e-876d-be10b4196751","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6804","nonce":3123352217}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6805","nonce":3123352217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6807","nonce":3123352217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6806","nonce":3123352217}]},"public_addr":"10.20.193.43:6804/3123352217","cluster_addr":"10.20.193.43:6805/3123352217","heartbeat_back_addr":"10.20.193.43:6807/3123352217","heartbeat_front_addr":"10.20.193.43:6806/3123352217","state":["exists","up"]},{"osd":3,"uuid":"2cb6a730-2373-4354-904c-57509d260325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6808","nonce":3250452844}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6809","nonce":3250452844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6811","nonce":3250452844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6810","nonce":3250452844}]},"public_addr":"10.20.193.46:6808/3250452844","cluster_addr":"10.20.193.46:6809/3250452844","heartbeat_back_addr":"10.20.193.46:6811/3250452844","heartbeat_front_addr":"10.20.193.46:6810/3250452844","state":["exists","up"]},{"osd":4,"uuid":"22624587-71c2-4992-b8bb-6ff8f9fad066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6802","nonce":3807500891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6804","nonce":3807500891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6807","nonce":3807500891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6806","nonce":3807500891}]},"public_addr":"10.20.193.46:6802/3807500891","cluster_addr":"10.20.193.46:6804/3807500891","heartbeat_back_addr":"10.20.193.46:6807/3807500891","heartbeat_front_addr":"10.20.193.46:6806/3807500891","state":["exists","up"]},{"osd":5,"uuid":"b7f8c29f-504c-4cfe-b959-03fe02b39f69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6800","nonce":1266691672}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6801","nonce":1266691672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6805","nonce":1266691672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6803","nonce":1266691672}]},"public_addr":"10.20.193.46:6800/1266691672","cluster_addr":"10.20.193.46:6801/1266691672","heartbeat_back_addr":"10.20.193.46:6805/1266691672","heartbeat_front_addr":"10.20.193.46:6803/1266691672","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.465320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.517324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.541306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.629304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.660956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.636067+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 10 librados: watch_flush enter 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 10 librados: watch_flush exit 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 20 client.4355.objecter shutdown clearing up homeless session... 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 10 client.4355.objecter successfully canceled tick 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 >> v1:10.20.193.46:6812/860801619 conn(0x7f0c6403e9d0 legacy=0x7f0c6405ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 10 monclient: shutdown 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 >> v1:10.20.193.43:6790/0 conn(0x7f0c9808d8d0 legacy=0x7f0c98106000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 shutdown_connections 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 >> 10.20.193.43:0/2706951962 conn(0x7f0c9808f480 msgr2=0x7f0c9811fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 shutdown_connections 2026-02-21T01:28:00.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 1 -- 10.20.193.43:0/2706951962 wait complete. 2026-02-21T01:28:00.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.207+0000 7f0c9d5e3640 1 librados: shutdown 2026-02-21T01:28:00.217 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-21T01:27:50.628015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-21T01:27:53.551352+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-21T01:28:00.217 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient: get_monmap_and_config 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient: monmap: 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:00.286405+0000 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:00.286405+0000 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:00.287 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:00.288 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 1 Processor -- start 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 1 -- start start 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient: init 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient(hunting): picked mon.noname-c con 0x7ff34005cef0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient(hunting): picked mon.noname-a con 0x7ff34008a730 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient(hunting): picked mon.noname-b con 0x7ff34013fa20 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34005d9d0 con 0x7ff34008a730 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34008b590 con 0x7ff34005cef0 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34005b9c0 con 0x7ff34013fa20 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff345b9b640 10 monclient(hunting): authenticate will time out at 611.991866s 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff33effd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff34008a730 0x7ff340180300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36574/0 (socket says 10.20.193.43:36574) 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.286+0000 7ff33effd640 1 -- 10.20.193.43:0/3459862280 learned_addr learned my addr 10.20.193.43:0/3459862280 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022452517 0 0) 0x7ff34005d9d0 con 0x7ff34008a730 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): my global_id is 4377 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff324003610 con 0x7ff34008a730 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375645844 0 0) 0x7ff34005b9c0 con 0x7ff34013fa20 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient(hunting): my global_id is 4358 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff34005d9d0 con 0x7ff34013fa20 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 277715080 0 0) 0x7ff324003610 con 0x7ff34008a730 2026-02-21T01:28:00.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 >> v1:10.20.193.43:6790/0 conn(0x7ff34013fa20 legacy=0x7ff3401a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 >> v1:10.20.193.46:6789/0 conn(0x7ff34005cef0 legacy=0x7ff34005d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 monclient: found mon.noname-a 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34013f210 con 0x7ff34008a730 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff330002d20 con 0x7ff34008a730 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 5 monclient: authenticate success, global_id 4377 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: dump: 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff330002fe0 con 0x7ff34008a730 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 1 -- 10.20.193.43:0/3459862280 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff330003420 con 0x7ff34008a730 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff33e7fc640 10 monclient: dump: 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.290 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 4 set_mon_vals no callback set 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 10 monclient: shutdown 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 1 -- 10.20.193.43:0/3459862280 >> v1:10.20.193.43:6789/0 conn(0x7ff34008a730 legacy=0x7ff340180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 1 -- 10.20.193.43:0/3459862280 shutdown_connections 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 1 -- 10.20.193.43:0/3459862280 >> 10.20.193.43:0/3459862280 conn(0x7ff34008f480 msgr2=0x7ff34008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 1 -- 10.20.193.43:0/3459862280 shutdown_connections 2026-02-21T01:28:00.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.287+0000 7ff345b9b640 1 -- 10.20.193.43:0/3459862280 wait complete. 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: monmap: 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 librados: starting msgr at 2026-02-21T01:28:00.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 librados: starting objecter 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 Processor -- start 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 -- start start 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 librados: setting wanted keys 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 librados: calling monclient init 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: init 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient(hunting): picked mon.noname-b con 0x7ff34005cef0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient(hunting): picked mon.noname-c con 0x7ff34008a730 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient(hunting): picked mon.noname-a con 0x7ff34013fa20 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34012c5d0 con 0x7ff34013fa20 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34005e1b0 con 0x7ff34005cef0 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34013bb90 con 0x7ff34008a730 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient(hunting): authenticate will time out at 611.993511s 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff33ffff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff34013fa20 0x7ff340191a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36586/0 (socket says 10.20.193.43:36586) 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff33effd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff34008a730 0x7ff340190340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53672/0 (socket says 10.20.193.43:53672) 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff33ffff640 1 -- 10.20.193.43:0/3212125376 learned_addr learned my addr 10.20.193.43:0/3212125376 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 client.?.objecter ms_handle_connect 0x7ff34008a730 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 client.?.objecter ms_handle_connect 0x7ff34013fa20 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035722957 0 0) 0x7ff34013bb90 con 0x7ff34008a730 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): my global_id is 4361 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff310003610 con 0x7ff34008a730 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830499477 0 0) 0x7ff34012c5d0 con 0x7ff34013fa20 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): my global_id is 4380 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff34013bb90 con 0x7ff34013fa20 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 client.?.objecter ms_handle_connect 0x7ff34005cef0 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2263969683 0 0) 0x7ff310003610 con 0x7ff34008a730 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff34012c5d0 con 0x7ff34008a730 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff330002ce0 con 0x7ff34008a730 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:28:00.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): dump: 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4141738730 0 0) 0x7ff34013bb90 con 0x7ff34013fa20 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff310003610 con 0x7ff34013fa20 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff3340034e0 con 0x7ff34013fa20 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient(hunting): dump: 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4271172468 0 0) 0x7ff34012c5d0 con 0x7ff34008a730 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 >> v1:10.20.193.46:6789/0 conn(0x7ff34005cef0 legacy=0x7ff34014f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 >> v1:10.20.193.43:6789/0 conn(0x7ff34013fa20 legacy=0x7ff340191a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 monclient: found mon.c 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34012c2f0 con 0x7ff34008a730 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 5 monclient: authenticate success, global_id 4361 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: _renew_subs 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff34012add0 con 0x7ff34008a730 2026-02-21T01:28:00.294 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: _renew_subs 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff3401299a0 con 0x7ff34008a730 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff345b9b640 1 librados: init done 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff330002ef0 con 0x7ff34008a730 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff330004d20 con 0x7ff34008a730 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff33dffb640 4 set_mon_vals no callback set 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.288+0000 7ff31bfff640 10 monclient: dump: 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff345b9b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff345b9b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff345b9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3400008d0 con 0x7ff34008a730 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff330004ec0 con 0x7ff34008a730 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7ff33004dc60 con 0x7ff34008a730 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff31bfff640 10 client.4361.objecter ms_dispatch2 0x7ff340000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff31bfff640 3 client.4361.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff31bfff640 3 client.4361.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff31bfff640 20 client.4361.objecter dump_active .. 0 homeless 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.289+0000 7ff33f7fe640 10 monclient: get_auth_request con 0x7ff31003e950 auth_method 0 2026-02-21T01:28:00.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.290+0000 7ff31bfff640 10 client.4361.objecter ms_handle_connect 0x7ff31003e950 2026-02-21T01:28:00.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.291+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff3300176f0 con 0x7ff34008a730 2026-02-21T01:28:00.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.291+0000 7ff31bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.291+0000 7ff31bfff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:00.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.401+0000 7ff345b9b640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-21T01:28:00.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.401+0000 7ff345b9b640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-21T01:28:00.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.401+0000 7ff345b9b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:00.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.401+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3401a3360 con 0x7ff34008a730 2026-02-21T01:28:00.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.401+0000 7ff31bfff640 1 -- 10.20.193.43:0/3212125376 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (unknown 3471955896 0 2170607528) 0x7ff330016ff0 con 0x7ff34008a730 2026-02-21T01:28:00.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.401+0000 7ff31bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-21T01:28:00.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.401+0000 7ff31bfff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:00.405 INFO:teuthology.orchestra.run.trial043.stdout:pg_num: 1 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 10 librados: watch_flush enter 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 10 librados: watch_flush exit 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 20 client.4361.objecter shutdown clearing up homeless session... 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 10 client.4361.objecter successfully canceled tick 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 >> v1:10.20.193.46:6812/860801619 conn(0x7ff31003e950 legacy=0x7ff31005ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 10 monclient: shutdown 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 >> v1:10.20.193.43:6790/0 conn(0x7ff34008a730 legacy=0x7ff340190340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 shutdown_connections 2026-02-21T01:28:00.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 >> 10.20.193.43:0/3212125376 conn(0x7ff34008f480 msgr2=0x7ff34013dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 shutdown_connections 2026-02-21T01:28:00.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 1 -- 10.20.193.43:0/3212125376 wait complete. 2026-02-21T01:28:00.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.403+0000 7ff345b9b640 1 librados: shutdown 2026-02-21T01:28:00.414 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-21T01:28:00.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient: get_monmap_and_config 2026-02-21T01:28:00.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient: monmap: 2026-02-21T01:28:00.493 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.493 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.493 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:00.483614+0000 2026-02-21T01:28:00.493 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:00.483614+0000 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 1 Processor -- start 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 1 -- start start 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient: init 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient(hunting): picked mon.noname-c con 0x7f0cdc08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient(hunting): picked mon.noname-a con 0x7f0cdc08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient(hunting): picked mon.noname-b con 0x7f0cdc08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cdc08a690 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cdc08b910 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cdc088ae0 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.483+0000 7f0ce4326640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 10 monclient(hunting): authenticate will time out at 612.189004s 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce189a640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f0cdc08d4d0 0x7f0cdc17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36600/0 (socket says 10.20.193.43:36600) 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce189a640 1 -- 10.20.193.43:0/744930390 learned_addr learned my addr 10.20.193.43:0/744930390 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861922383 0 0) 0x7f0cdc08a690 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): my global_id is 4383 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cc4003610 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104393158 0 0) 0x7f0cdc088ae0 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient(hunting): my global_id is 4364 2026-02-21T01:28:00.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cdc08a690 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3222604589 0 0) 0x7f0cc4003610 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 >> v1:10.20.193.43:6790/0 conn(0x7f0cdc08d8d0 legacy=0x7f0cdc19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 >> v1:10.20.193.46:6789/0 conn(0x7f0cdc08ddb0 legacy=0x7f0cdc08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 monclient: found mon.noname-a 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cdc1a3ef0 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0cd0002df0 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: dump: 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.498 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 5 monclient: authenticate success, global_id 4383 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0cd00030b0 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 1 -- 10.20.193.43:0/744930390 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0cd00034f0 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce1099640 10 monclient: dump: 2026-02-21T01:28:00.499 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 4 set_mon_vals no callback set 2026-02-21T01:28:00.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 10 monclient: shutdown 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 1 -- 10.20.193.43:0/744930390 >> v1:10.20.193.43:6789/0 conn(0x7f0cdc08d4d0 legacy=0x7f0cdc17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 1 -- 10.20.193.43:0/744930390 shutdown_connections 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 1 -- 10.20.193.43:0/744930390 >> 10.20.193.43:0/744930390 conn(0x7f0cdc08f480 msgr2=0x7f0cdc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 1 -- 10.20.193.43:0/744930390 shutdown_connections 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.484+0000 7f0ce4326640 1 -- 10.20.193.43:0/744930390 wait complete. 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: monmap: 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:00.501 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 librados: starting msgr at 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 librados: starting objecter 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 Processor -- start 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 -- start start 2026-02-21T01:28:00.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 librados: setting wanted keys 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 librados: calling monclient init 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: init 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient(hunting): picked mon.noname-b con 0x7f0cdc08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient(hunting): picked mon.noname-c con 0x7f0cdc08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient(hunting): picked mon.noname-a con 0x7f0cdc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cdc128ee0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cdc08c750 con 0x7f0cdc08d4d0 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cdc05e1b0 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient(hunting): authenticate will time out at 612.190518s 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce189a640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f0cdc08d8d0 0x7f0cdc086ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53682/0 (socket says 10.20.193.43:53682) 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce189a640 1 -- 10.20.193.43:0/1324991914 learned_addr learned my addr 10.20.193.43:0/1324991914 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 client.?.objecter ms_handle_connect 0x7f0cdc08d8d0 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 client.?.objecter ms_handle_connect 0x7f0cdc08ddb0 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558292706 0 0) 0x7f0cdc128ee0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): my global_id is 4386 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cac003610 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846537666 0 0) 0x7f0cdc05e1b0 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): my global_id is 4367 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cdc128ee0 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2750911815 0 0) 0x7f0cac003610 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cdc05e1b0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0cd8003320 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): dump: 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:00.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4077661944 0 0) 0x7f0cdc128ee0 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cac003610 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0cd0002db0 con 0x7f0cdc08d8d0 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient(hunting): dump: 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.507 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 client.?.objecter ms_handle_connect 0x7f0cdc08d4d0 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2158204197 0 0) 0x7f0cdc05e1b0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 >> v1:10.20.193.43:6790/0 conn(0x7f0cdc08d8d0 legacy=0x7f0cdc086ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 >> v1:10.20.193.46:6789/0 conn(0x7f0cdc08d4d0 legacy=0x7f0cdc086590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 monclient: found mon.a 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cdc088050 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 5 monclient: authenticate success, global_id 4386 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: _renew_subs 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0cdc1135b0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0cd80037e0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 client.4386.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: _renew_subs 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0cd8003bf0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0cdc128330 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce0898640 4 set_mon_vals no callback set 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0cc2ffd640 10 monclient: dump: 2026-02-21T01:28:00.510 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.485+0000 7f0ce4326640 1 librados: init done 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f0cd8003e10 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0ce4326640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.511 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0ce4326640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0ce4326640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cdc128740 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f0cd804cd80 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0cc2ffd640 10 client.4386.objecter ms_dispatch2 0x7f0cdc000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0cc2ffd640 3 client.4386.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0cc2ffd640 3 client.4386.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0cc2ffd640 20 client.4386.objecter dump_active .. 0 homeless 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.486+0000 7f0ce209b640 10 monclient: get_auth_request con 0x7f0cac03e980 auth_method 0 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.487+0000 7f0cc2ffd640 10 client.4386.objecter ms_handle_connect 0x7f0cac03e980 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.488+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f0cdc1135b0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.488+0000 7f0cc2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.512 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.488+0000 7f0cc2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.594+0000 7f0ce4326640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.594+0000 7f0ce4326640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.594+0000 7f0ce4326640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.594+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f0cdc054ff0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.594+0000 7f0cc2ffd640 1 -- 10.20.193.43:0/1324991914 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) ==== 92+0+10 (unknown 3412311620 0 265718887) 0x7f0cd80167b0 con 0x7f0cdc08ddb0 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.594+0000 7f0cc2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.594+0000 7f0cc2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:00.596 INFO:teuthology.orchestra.run.trial043.stdout:pg_num: 8 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 10 librados: watch_flush enter 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 10 librados: watch_flush exit 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 20 client.4386.objecter shutdown clearing up homeless session... 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 10 client.4386.objecter successfully canceled tick 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 >> v1:10.20.193.46:6812/860801619 conn(0x7f0cac03e980 legacy=0x7f0cac05ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 10 monclient: shutdown 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 >> v1:10.20.193.43:6789/0 conn(0x7f0cdc08ddb0 legacy=0x7f0cdc0873b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 shutdown_connections 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 >> 10.20.193.43:0/1324991914 conn(0x7f0cdc08f480 msgr2=0x7f0cdc1a3120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 shutdown_connections 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.595+0000 7f0ce4326640 1 -- 10.20.193.43:0/1324991914 wait complete. 2026-02-21T01:28:00.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.596+0000 7f0ce4326640 1 librados: shutdown 2026-02-21T01:28:00.605 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-21T01:28:00.605 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:28:00.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.671+0000 7f4558de0640 10 monclient: get_monmap_and_config 2026-02-21T01:28:00.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.671+0000 7f4558de0640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.671+0000 7f4558de0640 10 monclient: monmap: 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:00.672147+0000 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:00.672147+0000 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:00.682 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 1 Processor -- start 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 1 -- start start 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient: init 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient(hunting): picked mon.noname-b con 0x7f4554038ed0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient(hunting): picked mon.noname-c con 0x7f455408ee60 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient(hunting): picked mon.noname-a con 0x7f455413f5b0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45540392a0 con 0x7f455413f5b0 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455405dbb0 con 0x7f455408ee60 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455405de90 con 0x7f4554038ed0 2026-02-21T01:28:00.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 10 monclient(hunting): authenticate will time out at 612.377555s 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4552575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f4554038ed0 0x7f455408b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53688/0 (socket says 10.20.193.43:53688) 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4552575640 1 -- 10.20.193.43:0/519705971 learned_addr learned my addr 10.20.193.43:0/519705971 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464123362 0 0) 0x7f45540392a0 con 0x7f455413f5b0 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): my global_id is 4389 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4540003610 con 0x7f455413f5b0 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488717074 0 0) 0x7f455405de90 con 0x7f4554038ed0 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient(hunting): my global_id is 4370 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45540392a0 con 0x7f4554038ed0 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 339256207 0 0) 0x7f4540003610 con 0x7f455413f5b0 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 >> v1:10.20.193.43:6790/0 conn(0x7f4554038ed0 legacy=0x7f455408b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 >> v1:10.20.193.46:6789/0 conn(0x7f455408ee60 legacy=0x7f4554180400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 monclient: found mon.noname-a 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455405e170 con 0x7f455413f5b0 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4544003170 con 0x7f455413f5b0 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 10 monclient: dump: 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.686 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 5 monclient: authenticate success, global_id 4389 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4558de0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.672+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4544003400 con 0x7f455413f5b0 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4551573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4551573640 1 -- 10.20.193.43:0/519705971 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4544003840 con 0x7f455413f5b0 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 4 set_mon_vals no callback set 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4551573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4551573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4551573640 10 monclient: dump: 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.688 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 10 monclient: shutdown 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 1 -- 10.20.193.43:0/519705971 >> v1:10.20.193.43:6789/0 conn(0x7f455413f5b0 legacy=0x7f45541a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 1 -- 10.20.193.43:0/519705971 shutdown_connections 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 1 -- 10.20.193.43:0/519705971 >> 10.20.193.43:0/519705971 conn(0x7f455408c8e0 msgr2=0x7f455408d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 1 -- 10.20.193.43:0/519705971 shutdown_connections 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 1 -- 10.20.193.43:0/519705971 wait complete. 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.673+0000 7f4558de0640 10 monclient: monmap: 2026-02-21T01:28:00.689 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.690 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:00.690 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:00.690 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:00.690 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.690 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.690 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.690 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 librados: starting msgr at 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 librados: starting objecter 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 Processor -- start 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 -- start start 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 librados: setting wanted keys 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 librados: calling monclient init 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient: init 2026-02-21T01:28:00.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient(hunting): picked mon.noname-b con 0x7f4554038ed0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient(hunting): picked mon.noname-c con 0x7f455408ee60 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient(hunting): picked mon.noname-a con 0x7f455413f5b0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455413c850 con 0x7f455413f5b0 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4554137060 con 0x7f4554038ed0 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45541390e0 con 0x7f455408ee60 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient(hunting): authenticate will time out at 612.379490s 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4552d76640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f455413f5b0 0x7f4554191c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36632/0 (socket says 10.20.193.43:36632) 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4552d76640 1 -- 10.20.193.43:0/4098541857 learned_addr learned my addr 10.20.193.43:0/4098541857 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 client.?.objecter ms_handle_connect 0x7f455413f5b0 2026-02-21T01:28:00.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 client.?.objecter ms_handle_connect 0x7f455408ee60 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487385651 0 0) 0x7f455413c850 con 0x7f455413f5b0 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): my global_id is 4392 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4520003610 con 0x7f455413f5b0 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 client.?.objecter ms_handle_connect 0x7f4554038ed0 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829191329 0 0) 0x7f45541390e0 con 0x7f455408ee60 2026-02-21T01:28:00.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): my global_id is 4373 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f455413c850 con 0x7f455408ee60 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 121587875 0 0) 0x7f4520003610 con 0x7f455413f5b0 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45541390e0 con 0x7f455413f5b0 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4544003750 con 0x7f455413f5b0 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): dump: 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.694 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594304925 0 0) 0x7f4554137060 con 0x7f4554038ed0 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): my global_id is 4321 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4520003610 con 0x7f4554038ed0 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2602117316 0 0) 0x7f455413c850 con 0x7f455408ee60 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4554137060 con 0x7f455408ee60 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f453c002fc0 con 0x7f455408ee60 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient(hunting): dump: 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.696 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 24511402 0 0) 0x7f45541390e0 con 0x7f455413f5b0 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 >> v1:10.20.193.43:6790/0 conn(0x7f455408ee60 legacy=0x7f4554190500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 >> v1:10.20.193.46:6789/0 conn(0x7f4554038ed0 legacy=0x7f455414f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 monclient: found mon.a 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45541393c0 con 0x7f455413f5b0 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 5 monclient: authenticate success, global_id 4392 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient: _renew_subs 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4554137bc0 con 0x7f455413f5b0 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 client.4392.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient: _renew_subs 2026-02-21T01:28:00.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4554136830 con 0x7f455413f5b0 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4558de0640 1 librados: init done 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4544003e50 con 0x7f455413f5b0 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f45440041a0 con 0x7f455413f5b0 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f4550d72640 4 set_mon_vals no callback set 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.674+0000 7f453affd640 10 monclient: dump: 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.699 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f4558de0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f4558de0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f4558de0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455408d180 con 0x7f455413f5b0 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f45440043c0 con 0x7f455413f5b0 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f454404e0d0 con 0x7f455413f5b0 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f453affd640 10 client.4392.objecter ms_dispatch2 0x7f4554000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:00.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f453affd640 3 client.4392.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:00.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f453affd640 3 client.4392.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:00.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f453affd640 20 client.4392.objecter dump_active .. 0 homeless 2026-02-21T01:28:00.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.675+0000 7f4552575640 10 monclient: get_auth_request con 0x7f452003eb50 auth_method 0 2026-02-21T01:28:00.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.676+0000 7f453affd640 10 client.4392.objecter ms_handle_connect 0x7f452003eb50 2026-02-21T01:28:00.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.677+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4544017aa0 con 0x7f455413f5b0 2026-02-21T01:28:00.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.677+0000 7f453affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.677+0000 7f453affd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:00.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.781+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45540869a0 con 0x7f452003eb50 2026-02-21T01:28:00.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.781+0000 7f453affd640 1 -- 10.20.193.43:0/4098541857 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 2429789169) 0x7f45540869a0 con 0x7f452003eb50 2026-02-21T01:28:00.784 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:28:00.785 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 10 librados: watch_flush enter 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 10 librados: watch_flush exit 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 20 client.4392.objecter shutdown clearing up homeless session... 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 10 client.4392.objecter successfully canceled tick 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 >> v1:10.20.193.46:6812/860801619 conn(0x7f452003eb50 legacy=0x7f452005f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 10 monclient: shutdown 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 >> v1:10.20.193.43:6789/0 conn(0x7f455413f5b0 legacy=0x7f4554191c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 shutdown_connections 2026-02-21T01:28:00.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 >> 10.20.193.43:0/4098541857 conn(0x7f455408c8e0 msgr2=0x7f455408d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 shutdown_connections 2026-02-21T01:28:00.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 1 -- 10.20.193.43:0/4098541857 wait complete. 2026-02-21T01:28:00.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.782+0000 7f4558de0640 1 librados: shutdown 2026-02-21T01:28:00.792 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-21T01:28:00.614214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163768,"kb_used_data":2008,"kb_used_omap":53,"kb_used_meta":161610,"kb_avail":566067272,"statfs":{"total":579820584960,"available":579652886528,"internally_reserved":0,"allocated":2056192,"data_stored":1370530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54597,"internal_metadata":165489339},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.812149"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910464+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:27:56.910464+0000","last_peered":"2026-02-21T01:27:56.910464+0000","last_clean":"2026-02-21T01:27:56.910464+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:27:56.910464+0000","last_undegraded":"2026-02-21T01:27:56.910464+0000","last_fullsized":"2026-02-21T01:27:56.910464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809979+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:27:56.809979+0000","last_peered":"2026-02-21T01:27:56.809979+0000","last_clean":"2026-02-21T01:27:56.809979+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:27:56.809979+0000","last_undegraded":"2026-02-21T01:27:56.809979+0000","last_fullsized":"2026-02-21T01:27:56.809979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910390+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:27:56.910390+0000","last_peered":"2026-02-21T01:27:56.910390+0000","last_clean":"2026-02-21T01:27:56.910390+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:27:56.910390+0000","last_undegraded":"2026-02-21T01:27:56.910390+0000","last_fullsized":"2026-02-21T01:27:56.910390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.810259+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:27:56.810259+0000","last_peered":"2026-02-21T01:27:56.810259+0000","last_clean":"2026-02-21T01:27:56.810259+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:27:56.810259+0000","last_undegraded":"2026-02-21T01:27:56.810259+0000","last_fullsized":"2026-02-21T01:27:56.810259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.812512+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:27:56.812512+0000","last_peered":"2026-02-21T01:27:56.812512+0000","last_clean":"2026-02-21T01:27:56.812512+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:27:56.812512+0000","last_undegraded":"2026-02-21T01:27:56.812512+0000","last_fullsized":"2026-02-21T01:27:56.812512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809832+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:27:56.809832+0000","last_peered":"2026-02-21T01:27:56.809832+0000","last_clean":"2026-02-21T01:27:56.809832+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:27:56.809832+0000","last_undegraded":"2026-02-21T01:27:56.809832+0000","last_fullsized":"2026-02-21T01:27:56.809832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910246+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:27:56.910246+0000","last_peered":"2026-02-21T01:27:56.910246+0000","last_clean":"2026-02-21T01:27:56.910246+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:27:56.910246+0000","last_undegraded":"2026-02-21T01:27:56.910246+0000","last_fullsized":"2026-02-21T01:27:56.910246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.811979+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:27:56.811979+0000","last_peered":"2026-02-21T01:27:56.811979+0000","last_clean":"2026-02-21T01:27:56.811979+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:27:56.811979+0000","last_undegraded":"2026-02-21T01:27:56.811979+0000","last_fullsized":"2026-02-21T01:27:56.811979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.909753+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:27:56.909753+0000","last_peered":"2026-02-21T01:27:56.909753+0000","last_clean":"2026-02-21T01:27:56.909753+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:27:56.909753+0000","last_undegraded":"2026-02-21T01:27:56.909753+0000","last_fullsized":"2026-02-21T01:27:56.909753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:28:00.794 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:28:00.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.860+0000 7f73b2383640 10 monclient: get_monmap_and_config 2026-02-21T01:28:00.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.860+0000 7f73b2383640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.871 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.860+0000 7f73b2383640 10 monclient: monmap: 2026-02-21T01:28:00.871 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.871 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.871 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:00.861187+0000 2026-02-21T01:28:00.871 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:00.861187+0000 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 1 Processor -- start 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 1 -- start start 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient: init 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:00.872 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient(hunting): picked mon.noname-b con 0x7f73ac08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient(hunting): picked mon.noname-a con 0x7f73ac08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient(hunting): picked mon.noname-c con 0x7f73ac08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac08a690 con 0x7f73ac08d4d0 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac08b910 con 0x7f73ac08d8d0 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac088ae0 con 0x7f73ac08ddb0 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 10 monclient(hunting): authenticate will time out at 612.566649s 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73abfff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f73ac08ddb0 0x7f73ac08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:53704/0 (socket says 10.20.193.43:53704) 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73abfff640 1 -- 10.20.193.43:0/2468353941 learned_addr learned my addr 10.20.193.43:0/2468353941 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2588894546 0 0) 0x7f73ac08a690 con 0x7f73ac08d4d0 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.873 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): my global_id is 4395 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7390003610 con 0x7f73ac08d4d0 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302397466 0 0) 0x7f73ac088ae0 con 0x7f73ac08ddb0 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): my global_id is 4376 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ac08a690 con 0x7f73ac08ddb0 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968306164 0 0) 0x7f73ac08b910 con 0x7f73ac08d8d0 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.874 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient(hunting): my global_id is 4324 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ac088ae0 con 0x7f73ac08d8d0 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3331274355 0 0) 0x7f7390003610 con 0x7f73ac08d4d0 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 >> v1:10.20.193.43:6790/0 conn(0x7f73ac08ddb0 legacy=0x7f73ac08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 >> v1:10.20.193.46:6789/0 conn(0x7f73ac08d8d0 legacy=0x7f73ac19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 monclient: found mon.noname-a 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac1a3ef0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.875 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f739c002d20 con 0x7f73ac08d4d0 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73aaffd640 10 monclient: dump: 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.876 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 5 monclient: authenticate success, global_id 4395 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.861+0000 7f73b2383640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f739c002fe0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73aaffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73aaffd640 1 -- 10.20.193.43:0/2468353941 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f739c003420 con 0x7f73ac08d4d0 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73aaffd640 10 monclient: dump: 2026-02-21T01:28:00.877 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 4 set_mon_vals no callback set 2026-02-21T01:28:00.878 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 10 monclient: shutdown 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 1 -- 10.20.193.43:0/2468353941 >> v1:10.20.193.43:6789/0 conn(0x7f73ac08d4d0 legacy=0x7f73ac17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 1 -- 10.20.193.43:0/2468353941 shutdown_connections 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 1 -- 10.20.193.43:0/2468353941 >> 10.20.193.43:0/2468353941 conn(0x7f73ac08f480 msgr2=0x7f73ac08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 1 -- 10.20.193.43:0/2468353941 shutdown_connections 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 1 -- 10.20.193.43:0/2468353941 wait complete. 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 10 monclient: build_initial_monmap 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 10 monclient: monmap: 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:00.879 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 1 librados: starting msgr at 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.862+0000 7f73b2383640 1 librados: starting objecter 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 Processor -- start 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 -- start start 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 librados: setting wanted keys 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 librados: calling monclient init 2026-02-21T01:28:00.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient: init 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient(hunting): picked mon.noname-a con 0x7f73ac08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient(hunting): picked mon.noname-b con 0x7f73ac08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient(hunting): picked mon.noname-c con 0x7f73ac08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac146d70 con 0x7f73ac08d4d0 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac12b650 con 0x7f73ac08d8d0 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac12d150 con 0x7f73ac08ddb0 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient(hunting): authenticate will time out at 612.568350s 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73abfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f73ac08d4d0 0x7f73ac146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36662/0 (socket says 10.20.193.43:36662) 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73abfff640 1 -- 10.20.193.43:0/3465757453 learned_addr learned my addr 10.20.193.43:0/3465757453 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:00.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 client.?.objecter ms_handle_connect 0x7f73ac08d4d0 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 client.?.objecter ms_handle_connect 0x7f73ac08ddb0 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284725732 0 0) 0x7f73ac146d70 con 0x7f73ac08d4d0 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): my global_id is 4398 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f737c003610 con 0x7f73ac08d4d0 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757067364 0 0) 0x7f73ac12d150 con 0x7f73ac08ddb0 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:28:00.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): my global_id is 4379 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ac146d70 con 0x7f73ac08ddb0 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3496893826 0 0) 0x7f737c003610 con 0x7f73ac08d4d0 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73ac12d150 con 0x7f73ac08d4d0 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f73980030b0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): dump: 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.883 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2262199273 0 0) 0x7f73ac146d70 con 0x7f73ac08ddb0 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f737c003610 con 0x7f73ac08ddb0 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f73a0003410 con 0x7f73ac08ddb0 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:00.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient(hunting): dump: 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.885 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3079875963 0 0) 0x7f73ac12d150 con 0x7f73ac08d4d0 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 >> v1:10.20.193.43:6790/0 conn(0x7f73ac08ddb0 legacy=0x7f73ac18f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 >> v1:10.20.193.46:6789/0 conn(0x7f73ac08d8d0 legacy=0x7f73ac18da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 monclient: found mon.a 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac12bc60 con 0x7f73ac08d4d0 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: _finish_auth 0 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:00.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 5 monclient: authenticate success, global_id 4398 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient: _renew_subs 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac12dfc0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 client.4398.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient: _renew_subs 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f73ac12c9a0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73b2383640 1 librados: init done 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7398003460 con 0x7f73ac08d4d0 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7398004d20 con 0x7f73ac08d4d0 2026-02-21T01:28:00.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73a8ff9640 10 monclient: dump: 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:00.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.863+0000 7f73aa7fc640 4 set_mon_vals no callback set 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73b2383640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73b2383640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73b2383640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac08edd0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f73980116a0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f739804dcc0 con 0x7f73ac08d4d0 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73a8ff9640 10 client.4398.objecter ms_dispatch2 0x7f73ac000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73a8ff9640 3 client.4398.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73a8ff9640 3 client.4398.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73a8ff9640 20 client.4398.objecter dump_active .. 0 homeless 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.864+0000 7f73ab7fe640 10 monclient: get_auth_request con 0x7f737c03e900 auth_method 0 2026-02-21T01:28:00.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.865+0000 7f73a8ff9640 10 client.4398.objecter ms_handle_connect 0x7f737c03e900 2026-02-21T01:28:00.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.866+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7398017690 con 0x7f73ac08d4d0 2026-02-21T01:28:00.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.866+0000 7f73a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:00.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.866+0000 7f73a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:00.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.971+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73ac054ff0 con 0x7f737c03e900 2026-02-21T01:28:00.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.971+0000 7f73a8ff9640 1 -- 10.20.193.43:0/3465757453 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 2429789169) 0x7f73ac054ff0 con 0x7f737c03e900 2026-02-21T01:28:00.974 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:28:00.975 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:28:00.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 10 librados: watch_flush enter 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 10 librados: watch_flush exit 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 20 client.4398.objecter shutdown clearing up homeless session... 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 10 client.4398.objecter successfully canceled tick 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 >> v1:10.20.193.46:6812/860801619 conn(0x7f737c03e900 legacy=0x7f737c05edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 10 monclient: shutdown 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 >> v1:10.20.193.43:6789/0 conn(0x7f73ac08d4d0 legacy=0x7f73ac146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 shutdown_connections 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.972+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 >> 10.20.193.43:0/3465757453 conn(0x7f73ac08f480 msgr2=0x7f73ac05c370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.973+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 shutdown_connections 2026-02-21T01:28:00.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.973+0000 7f73b2383640 1 -- 10.20.193.43:0/3465757453 wait complete. 2026-02-21T01:28:00.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:00.973+0000 7f73b2383640 1 librados: shutdown 2026-02-21T01:28:00.982 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-21T01:28:00.614214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163768,"kb_used_data":2008,"kb_used_omap":53,"kb_used_meta":161610,"kb_avail":566067272,"statfs":{"total":579820584960,"available":579652886528,"internally_reserved":0,"allocated":2056192,"data_stored":1370530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54597,"internal_metadata":165489339},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.812149"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910464+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:27:56.910464+0000","last_peered":"2026-02-21T01:27:56.910464+0000","last_clean":"2026-02-21T01:27:56.910464+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:27:56.910464+0000","last_undegraded":"2026-02-21T01:27:56.910464+0000","last_fullsized":"2026-02-21T01:27:56.910464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809979+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:27:56.809979+0000","last_peered":"2026-02-21T01:27:56.809979+0000","last_clean":"2026-02-21T01:27:56.809979+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:27:56.809979+0000","last_undegraded":"2026-02-21T01:27:56.809979+0000","last_fullsized":"2026-02-21T01:27:56.809979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910390+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:27:56.910390+0000","last_peered":"2026-02-21T01:27:56.910390+0000","last_clean":"2026-02-21T01:27:56.910390+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:27:56.910390+0000","last_undegraded":"2026-02-21T01:27:56.910390+0000","last_fullsized":"2026-02-21T01:27:56.910390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.810259+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:27:56.810259+0000","last_peered":"2026-02-21T01:27:56.810259+0000","last_clean":"2026-02-21T01:27:56.810259+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:27:56.810259+0000","last_undegraded":"2026-02-21T01:27:56.810259+0000","last_fullsized":"2026-02-21T01:27:56.810259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.812512+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:27:56.812512+0000","last_peered":"2026-02-21T01:27:56.812512+0000","last_clean":"2026-02-21T01:27:56.812512+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:27:56.812512+0000","last_undegraded":"2026-02-21T01:27:56.812512+0000","last_fullsized":"2026-02-21T01:27:56.812512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.809832+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:27:56.809832+0000","last_peered":"2026-02-21T01:27:56.809832+0000","last_clean":"2026-02-21T01:27:56.809832+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:27:56.809832+0000","last_undegraded":"2026-02-21T01:27:56.809832+0000","last_fullsized":"2026-02-21T01:27:56.809832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.910246+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:27:56.910246+0000","last_peered":"2026-02-21T01:27:56.910246+0000","last_clean":"2026-02-21T01:27:56.910246+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:27:56.910246+0000","last_undegraded":"2026-02-21T01:27:56.910246+0000","last_fullsized":"2026-02-21T01:27:56.910246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.811979+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:27:56.811979+0000","last_peered":"2026-02-21T01:27:56.811979+0000","last_clean":"2026-02-21T01:27:56.811979+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:27:56.811979+0000","last_undegraded":"2026-02-21T01:27:56.811979+0000","last_fullsized":"2026-02-21T01:27:56.811979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-21T01:27:56.909753+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:27:56.909753+0000","last_peered":"2026-02-21T01:27:56.909753+0000","last_clean":"2026-02-21T01:27:56.909753+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:27:56.909753+0000","last_undegraded":"2026-02-21T01:27:56.909753+0000","last_fullsized":"2026-02-21T01:27:56.909753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":680,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":696320,"data_stored":581034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:28:00.984 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-21T01:28:00.984 DEBUG:tasks.mon_thrash:Yielding 2026-02-21T01:28:00.984 INFO:teuthology.run_tasks:Running task workunit... 2026-02-21T01:28:01.001 INFO:tasks.workunit:Pulling workunits from ref 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-21T01:28:01.001 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-21T01:28:01.002 DEBUG:teuthology.orchestra.run.trial046:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-21T01:28:01.002 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-21T01:28:01.002 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771637280, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-21T01:28:01.002 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:28:01.002 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:28:01.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:28:01.020 INFO:teuthology.orchestra.run.trial046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-21T01:28:01.020 DEBUG:teuthology.orchestra.run.trial046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-21T01:28:01.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.066+0000 7f98e129d640 10 monclient: get_monmap_and_config 2026-02-21T01:28:01.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.066+0000 7f98e129d640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.066+0000 7f98e129d640 10 monclient: monmap: 2026-02-21T01:28:01.068 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.068 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.068 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:01.066992+0000 2026-02-21T01:28:01.068 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:01.066992+0000 2026-02-21T01:28:01.069 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.069 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.069 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.069 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:01.069 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:01.069 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.078 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-21T01:28:01.078 DEBUG:teuthology.orchestra.run.trial046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-21T01:28:01.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 1 Processor -- start 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 1 -- start start 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient: init 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient(hunting): picked mon.noname-a con 0x7f98dc0580b0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient(hunting): picked mon.noname-c con 0x7f98dc058480 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient(hunting): picked mon.noname-b con 0x7f98dc181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc0562b0 con 0x7f98dc0580b0 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc056590 con 0x7f98dc058480 2026-02-21T01:28:01.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc056870 con 0x7f98dc181e80 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient(hunting): authenticate will time out at 612.772470s 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98daffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f98dc0580b0 0x7f98dc08e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41424/0 (socket says 10.20.193.43:41424) 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98daffd640 1 -- 10.20.193.43:0/2375705547 learned_addr learned my addr 10.20.193.43:0/2375705547 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98db7fe640 1 --1- 10.20.193.43:0/2375705547 >> v1:10.20.193.43:6790/0 conn(0x7f98dc181e80 0x7f98dc1a2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:39204/0 (socket says 10.20.193.43:39204) 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996147555 0 0) 0x7f98dc0562b0 con 0x7f98dc0580b0 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): my global_id is 4401 2026-02-21T01:28:01.081 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98c8003610 con 0x7f98dc0580b0 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660105351 0 0) 0x7f98dc056870 con 0x7f98dc181e80 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): my global_id is 4382 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98dc0562b0 con 0x7f98dc181e80 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152926565 0 0) 0x7f98dc056590 con 0x7f98dc058480 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient(hunting): my global_id is 4327 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98dc056870 con 0x7f98dc058480 2026-02-21T01:28:01.082 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1643419744 0 0) 0x7f98c8003610 con 0x7f98dc0580b0 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 >> v1:10.20.193.43:6790/0 conn(0x7f98dc181e80 legacy=0x7f98dc1a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 >> v1:10.20.193.46:6789/0 conn(0x7f98dc058480 legacy=0x7f98dc08e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 monclient: found mon.noname-a 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc0931d0 con 0x7f98dc0580b0 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.083 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f98d0002df0 con 0x7f98dc0580b0 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: dump: 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.084 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 5 monclient: authenticate success, global_id 4401 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98d0002fc0 con 0x7f98dc0580b0 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 1 -- 10.20.193.43:0/2375705547 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f98d0003400 con 0x7f98dc0580b0 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98d9ffb640 10 monclient: dump: 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.085 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.067+0000 7f98e129d640 4 set_mon_vals no callback set 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 10 monclient: shutdown 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 -- 10.20.193.43:0/2375705547 >> v1:10.20.193.43:6789/0 conn(0x7f98dc0580b0 legacy=0x7f98dc08e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 -- 10.20.193.43:0/2375705547 shutdown_connections 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 -- 10.20.193.43:0/2375705547 >> 10.20.193.43:0/2375705547 conn(0x7f98dc094200 msgr2=0x7f98dc090180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 -- 10.20.193.43:0/2375705547 shutdown_connections 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 -- 10.20.193.43:0/2375705547 wait complete. 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 10 monclient: monmap: 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:01.087 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 librados: starting msgr at 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 librados: starting objecter 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.068+0000 7f98e129d640 1 Processor -- start 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 -- start start 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 librados: setting wanted keys 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 librados: calling monclient init 2026-02-21T01:28:01.088 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient: init 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient(hunting): picked mon.noname-b con 0x7f98dc0580b0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient(hunting): picked mon.noname-a con 0x7f98dc058480 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient(hunting): picked mon.noname-c con 0x7f98dc181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc149bb0 con 0x7f98dc058480 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc130e00 con 0x7f98dc0580b0 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc12ff90 con 0x7f98dc181e80 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient(hunting): authenticate will time out at 612.774271s 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98da7fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f98dc058480 0x7f98dc170850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41432/0 (socket says 10.20.193.43:41432) 2026-02-21T01:28:01.089 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98da7fc640 1 -- 10.20.193.43:0/2082638473 learned_addr learned my addr 10.20.193.43:0/2082638473 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 client.?.objecter ms_handle_connect 0x7f98dc058480 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 client.?.objecter ms_handle_connect 0x7f98dc181e80 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689970405 0 0) 0x7f98dc12ff90 con 0x7f98dc181e80 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): my global_id is 4385 2026-02-21T01:28:01.090 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a8003610 con 0x7f98dc181e80 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465072798 0 0) 0x7f98dc149bb0 con 0x7f98dc058480 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): my global_id is 4404 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98dc12ff90 con 0x7f98dc058480 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 client.?.objecter ms_handle_connect 0x7f98dc0580b0 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2509680976 0 0) 0x7f98a8003610 con 0x7f98dc181e80 2026-02-21T01:28:01.091 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98dc149bb0 con 0x7f98dc181e80 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f98cc003430 con 0x7f98dc181e80 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): dump: 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.092 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 655814595 0 0) 0x7f98dc12ff90 con 0x7f98dc058480 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98a8003610 con 0x7f98dc058480 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f98c4003170 con 0x7f98dc058480 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): dump: 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.093 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603283822 0 0) 0x7f98dc130e00 con 0x7f98dc0580b0 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient(hunting): my global_id is 4330 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98dc12ff90 con 0x7f98dc0580b0 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 360473101 0 0) 0x7f98dc149bb0 con 0x7f98dc181e80 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 >> v1:10.20.193.46:6789/0 conn(0x7f98dc0580b0 legacy=0x7f98dc1494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 >> v1:10.20.193.43:6789/0 conn(0x7f98dc058480 legacy=0x7f98dc170850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 monclient: found mon.c 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc12eaa0 con 0x7f98dc181e80 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 5 monclient: authenticate success, global_id 4385 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient: _renew_subs 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f98dc130560 con 0x7f98dc181e80 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 client.4385.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient: _renew_subs 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f98dc12f600 con 0x7f98dc181e80 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98e129d640 1 librados: init done 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98cc004c50 con 0x7f98dc181e80 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f98cc004fa0 con 0x7f98dc181e80 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:01.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98d97fa640 4 set_mon_vals no callback set 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.069+0000 7f98bb7fe640 10 monclient: dump: 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98e129d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98e129d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98e129d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98dc08f930 con 0x7f98dc181e80 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f98cc011920 con 0x7f98dc181e80 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f98cc04e010 con 0x7f98dc181e80 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98bb7fe640 10 client.4385.objecter ms_dispatch2 0x7f98dc000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98bb7fe640 3 client.4385.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98bb7fe640 3 client.4385.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98bb7fe640 20 client.4385.objecter dump_active .. 0 homeless 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98daffd640 10 monclient: get_auth_request con 0x7f98a803eb60 auth_method 0 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.070+0000 7f98bb7fe640 10 client.4385.objecter ms_handle_connect 0x7f98a803eb60 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.072+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f98dc08f930 con 0x7f98dc181e80 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.072+0000 7f98bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.072+0000 7f98bb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:01.134 INFO:tasks.workunit:timeout=3h 2026-02-21T01:28:01.134 INFO:tasks.workunit:cleanup=True 2026-02-21T01:28:01.135 DEBUG:teuthology.orchestra.run.trial046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-21T01:28:01.197 INFO:tasks.workunit.client.0.trial046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-21T01:28:01.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.224+0000 7f98e129d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:28:01.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.224+0000 7f98e129d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:01.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.224+0000 7f98e129d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.224+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f98dc054e20 con 0x7f98dc181e80 2026-02-21T01:28:01.226 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.224+0000 7f98bb7fe640 1 -- 10.20.193.43:0/2082638473 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 388622310) 0x7f98cc0179e0 con 0x7f98dc181e80 2026-02-21T01:28:01.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.224+0000 7f98bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:01.227 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.224+0000 7f98bb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:01.227 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:28:01.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 10 librados: watch_flush enter 2026-02-21T01:28:01.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 10 librados: watch_flush exit 2026-02-21T01:28:01.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 20 client.4385.objecter shutdown clearing up homeless session... 2026-02-21T01:28:01.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 10 client.4385.objecter successfully canceled tick 2026-02-21T01:28:01.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 >> v1:10.20.193.46:6812/860801619 conn(0x7f98a803eb60 legacy=0x7f98a805f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 10 monclient: shutdown 2026-02-21T01:28:01.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 >> v1:10.20.193.43:6790/0 conn(0x7f98dc181e80 legacy=0x7f98dc171f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 shutdown_connections 2026-02-21T01:28:01.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 >> 10.20.193.43:0/2082638473 conn(0x7f98dc094200 msgr2=0x7f98dc08b490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 shutdown_connections 2026-02-21T01:28:01.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 1 -- 10.20.193.43:0/2082638473 wait complete. 2026-02-21T01:28:01.232 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.225+0000 7f98e129d640 1 librados: shutdown 2026-02-21T01:28:01.235 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:28:01.235 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-21T01:28:01.236 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:28:01.236 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.302+0000 7f921260c640 10 monclient: get_monmap_and_config 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.302+0000 7f921260c640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.302+0000 7f921260c640 10 monclient: monmap: 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:01.302895+0000 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:01.302895+0000 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:01.304 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.302+0000 7f921260c640 1 Processor -- start 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.302+0000 7f921260c640 1 -- start start 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.302+0000 7f921260c640 10 monclient: init 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient(hunting): picked mon.noname-b con 0x7f920c05cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient(hunting): picked mon.noname-a con 0x7f920c08a730 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient(hunting): picked mon.noname-c con 0x7f920c13fa20 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c05d9d0 con 0x7f920c08a730 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c08b590 con 0x7f920c13fa20 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c05b9c0 con 0x7f920c05cef0 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient(hunting): authenticate will time out at 613.008323s 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920b7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f920c08a730 0x7f920c180300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41440/0 (socket says 10.20.193.43:41440) 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920b7fe640 1 -- 10.20.193.43:0/4249624222 learned_addr learned my addr 10.20.193.43:0/4249624222 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920bfff640 1 --1- 10.20.193.43:0/4249624222 >> v1:10.20.193.43:6790/0 conn(0x7f920c05cef0 0x7f920c05d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:39232/0 (socket says 10.20.193.43:39232) 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544909909 0 0) 0x7f920c05d9d0 con 0x7f920c08a730 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): my global_id is 4407 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f0003610 con 0x7f920c08a730 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479868043 0 0) 0x7f920c05b9c0 con 0x7f920c05cef0 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient(hunting): my global_id is 4388 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c05d9d0 con 0x7f920c05cef0 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3914746829 0 0) 0x7f91f0003610 con 0x7f920c08a730 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 >> v1:10.20.193.43:6790/0 conn(0x7f920c05cef0 legacy=0x7f920c05d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 >> v1:10.20.193.46:6789/0 conn(0x7f920c13fa20 legacy=0x7f920c1a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 monclient: found mon.noname-a 2026-02-21T01:28:01.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c13f210 con 0x7f920c08a730 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91fc002df0 con 0x7f920c08a730 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: dump: 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 5 monclient: authenticate success, global_id 4407 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91fc003070 con 0x7f920c08a730 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 1 -- 10.20.193.43:0/4249624222 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91fc0034b0 con 0x7f920c08a730 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f920affd640 10 monclient: dump: 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.307 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.303+0000 7f921260c640 4 set_mon_vals no callback set 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient: shutdown 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- 10.20.193.43:0/4249624222 >> v1:10.20.193.43:6789/0 conn(0x7f920c08a730 legacy=0x7f920c180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- 10.20.193.43:0/4249624222 shutdown_connections 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- 10.20.193.43:0/4249624222 >> 10.20.193.43:0/4249624222 conn(0x7f920c08f480 msgr2=0x7f920c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- 10.20.193.43:0/4249624222 shutdown_connections 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- 10.20.193.43:0/4249624222 wait complete. 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient: monmap: 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 librados: starting msgr at 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 librados: starting objecter 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 Processor -- start 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- start start 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 librados: setting wanted keys 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 librados: calling monclient init 2026-02-21T01:28:01.308 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient: init 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient(hunting): picked mon.noname-c con 0x7f920c05cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient(hunting): picked mon.noname-a con 0x7f920c08a730 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient(hunting): picked mon.noname-b con 0x7f920c13fa20 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c128bb0 con 0x7f920c08a730 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c05e1b0 con 0x7f920c13fa20 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c126850 con 0x7f920c05cef0 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f921260c640 10 monclient(hunting): authenticate will time out at 613.009922s 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f920b7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f920c08a730 0x7f920c1a0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41448/0 (socket says 10.20.193.43:41448) 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f920b7fe640 1 -- 10.20.193.43:0/917587194 learned_addr learned my addr 10.20.193.43:0/917587194 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.304+0000 7f9208ff9640 10 client.?.objecter ms_handle_connect 0x7f920c08a730 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 client.?.objecter ms_handle_connect 0x7f920c05cef0 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174466441 0 0) 0x7f920c128bb0 con 0x7f920c08a730 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): my global_id is 4410 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91dc003610 con 0x7f920c08a730 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294078445 0 0) 0x7f920c126850 con 0x7f920c05cef0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): my global_id is 4391 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c128bb0 con 0x7f920c05cef0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2135720915 0 0) 0x7f91dc003610 con 0x7f920c08a730 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f920c126850 con 0x7f920c08a730 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91fc002d00 con 0x7f920c08a730 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): dump: 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3729986888 0 0) 0x7f920c128bb0 con 0x7f920c05cef0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91dc003610 con 0x7f920c05cef0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91f8002fb0 con 0x7f920c05cef0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient(hunting): dump: 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.311 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 client.?.objecter ms_handle_connect 0x7f920c13fa20 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 306971186 0 0) 0x7f920c126850 con 0x7f920c08a730 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.43:6790/0 conn(0x7f920c05cef0 legacy=0x7f920c120e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.46:6789/0 conn(0x7f920c13fa20 legacy=0x7f920c1a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 monclient: found mon.a 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c1285f0 con 0x7f920c08a730 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 5 monclient: authenticate success, global_id 4410 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 10 monclient: _renew_subs 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f920c128370 con 0x7f920c08a730 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91fc004ce0 con 0x7f920c08a730 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 10 client.4410.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 10 monclient: _renew_subs 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91fc005030 con 0x7f920c08a730 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f920c121510 con 0x7f920c08a730 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 1 librados: init done 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f920a7fc640 4 set_mon_vals no callback set 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 10 monclient: dump: 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.312 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f920c08abb0 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.305+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f91fc011a30 con 0x7f920c08a730 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 client.4410.objecter ms_handle_connect 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 client.4410.objecter resend_mon_ops 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f91fc04dd10 con 0x7f920c08a730 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 client.4410.objecter ms_dispatch2 0x7f920c000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 3 client.4410.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 3 client.4410.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 20 client.4410.objecter dump_active .. 0 homeless 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769488797 0 0) 0x7f920c08abb0 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient(hunting): my global_id is 4413 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c126850 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9210b82640 10 monclient: get_auth_request con 0x7f91dc03e8a0 auth_method 0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2271246882 0 0) 0x7f920c126850 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f920c08abb0 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91f80048d0 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient: dump: 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1267219532 0 0) 0x7f920c08abb0 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f920c13c110 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 client.4410.objecter ms_handle_connect 0x7f91dc03e8a0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f91f8003540 con 0x7f920c1273b0 2026-02-21T01:28:01.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.43:6789/0 conn(0x7f920c1273b0 legacy=0x7f920c087740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.306+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.43:6789/0 conn(0x7f920c1273b0 legacy=0x7f920c087740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f921260c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f920c054ff0 con 0x7f920c125da0 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 10 client.4410.objecter ms_handle_connect 0x7f920c125da0 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 10 client.4410.objecter resend_mon_ops 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732608931 0 0) 0x7f920c054ff0 con 0x7f920c125da0 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 10 monclient(hunting): my global_id is 4416 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.309+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c08abb0 con 0x7f920c125da0 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 730484682 0 0) 0x7f920c08abb0 con 0x7f920c125da0 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f920c054ff0 con 0x7f920c125da0 2026-02-21T01:28:01.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91f8005030 con 0x7f920c125da0 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 10 monclient: dump: 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2877199686 0 0) 0x7f920c054ff0 con 0x7f920c125da0 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f920c1a3360 con 0x7f920c125da0 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4317 (unknown 0 0 527534017) 0x7f91f80050a0 con 0x7f920c125da0 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.43:6789/0 conn(0x7f920c125da0 legacy=0x7f920c087e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9208ff9640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.43:6789/0 conn(0x7f920c125da0 legacy=0x7f920c087e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 4, 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 16940, 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 16, 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:01.315 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:01.316 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.317 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.318 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:28:01.319 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 10 librados: watch_flush enter 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 10 librados: watch_flush exit 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 20 client.4410.objecter shutdown clearing up homeless session... 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 10 client.4410.objecter successfully canceled tick 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.46:6812/860801619 conn(0x7f91dc03e8a0 legacy=0x7f91dc05ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 10 monclient: shutdown 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 >> v1:10.20.193.43:6789/0 conn(0x7f920c08a730 legacy=0x7f920c1a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f9210b82640 1 -- 10.20.193.43:0/917587194 reap_dead start 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 shutdown_connections 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 >> 10.20.193.43:0/917587194 conn(0x7f920c08f480 msgr2=0x7f920c08bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 shutdown_connections 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 1 -- 10.20.193.43:0/917587194 wait complete. 2026-02-21T01:28:01.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.310+0000 7f921260c640 1 librados: shutdown 2026-02-21T01:28:01.320 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:28:01.320 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:28:01.320 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.385+0000 7f4708616640 10 monclient: get_monmap_and_config 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.385+0000 7f4708616640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.385+0000 7f4708616640 10 monclient: monmap: 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:01.385906+0000 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:01.385906+0000 2026-02-21T01:28:01.387 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.388 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.388 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.388 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:01.388 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:01.388 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 1 Processor -- start 2026-02-21T01:28:01.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 1 -- start start 2026-02-21T01:28:01.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient: init 2026-02-21T01:28:01.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:28:01.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient(hunting): picked mon.noname-a con 0x7f470013efc0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient(hunting): picked mon.noname-b con 0x7f470008de90 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient(hunting): picked mon.noname-c con 0x7f470013faa0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470008e910 con 0x7f470013efc0 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470008ebf0 con 0x7f470013faa0 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470008eed0 con 0x7f470008de90 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 10 monclient(hunting): authenticate will time out at 613.091548s 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f470638b640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f470013efc0 0x7f470013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41466/0 (socket says 10.20.193.43:41466) 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f470638b640 1 -- 10.20.193.43:0/2204908804 learned_addr learned my addr 10.20.193.43:0/2204908804 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350271079 0 0) 0x7f470008e910 con 0x7f470013efc0 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): my global_id is 4419 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e8003610 con 0x7f470013efc0 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161417494 0 0) 0x7f470008eed0 con 0x7f470008de90 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient(hunting): my global_id is 4394 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f470008e910 con 0x7f470008de90 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1016712125 0 0) 0x7f46e8003610 con 0x7f470013efc0 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 >> v1:10.20.193.43:6790/0 conn(0x7f470008de90 legacy=0x7f47001804f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 >> v1:10.20.193.46:6789/0 conn(0x7f470013faa0 legacy=0x7f47001a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 monclient: found mon.noname-a 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470008f1b0 con 0x7f470013efc0 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f46f0002df0 con 0x7f470013efc0 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4705389640 10 monclient: dump: 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 5 monclient: authenticate success, global_id 4419 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.386+0000 7f4708616640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46f0002fc0 con 0x7f470013efc0 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4705389640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 4 set_mon_vals no callback set 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4705389640 1 -- 10.20.193.43:0/2204908804 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f46f0003400 con 0x7f470013efc0 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4705389640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4705389640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4705389640 10 monclient: dump: 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 10 monclient: shutdown 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 1 -- 10.20.193.43:0/2204908804 >> v1:10.20.193.43:6789/0 conn(0x7f470013efc0 legacy=0x7f470013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 1 -- 10.20.193.43:0/2204908804 shutdown_connections 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 1 -- 10.20.193.43:0/2204908804 >> 10.20.193.43:0/2204908804 conn(0x7f4700093d40 msgr2=0x7f470008ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 1 -- 10.20.193.43:0/2204908804 shutdown_connections 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 1 -- 10.20.193.43:0/2204908804 wait complete. 2026-02-21T01:28:01.398 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 10 monclient: monmap: 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 1 librados: starting msgr at 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.387+0000 7f4708616640 1 librados: starting objecter 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 Processor -- start 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 -- start start 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 librados: setting wanted keys 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 librados: calling monclient init 2026-02-21T01:28:01.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient: init 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient(hunting): picked mon.noname-c con 0x7f470008de90 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient(hunting): picked mon.noname-a con 0x7f470013efc0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient(hunting): picked mon.noname-b con 0x7f470013faa0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470012d9d0 con 0x7f470013efc0 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470012ab90 con 0x7f470013faa0 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470013d310 con 0x7f470008de90 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient(hunting): authenticate will time out at 613.093321s 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f470638b640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f470008de90 0x7f4700129d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:39250/0 (socket says 10.20.193.43:39250) 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f470638b640 1 -- 10.20.193.43:0/120788811 learned_addr learned my addr 10.20.193.43:0/120788811 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 client.?.objecter ms_handle_connect 0x7f470013efc0 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 client.?.objecter ms_handle_connect 0x7f470008de90 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914434232 0 0) 0x7f470013d310 con 0x7f470008de90 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): my global_id is 4397 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d0003610 con 0x7f470008de90 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477680771 0 0) 0x7f470012d9d0 con 0x7f470013efc0 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): my global_id is 4422 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f470013d310 con 0x7f470013efc0 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3755675505 0 0) 0x7f46d0003610 con 0x7f470008de90 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f470012d9d0 con 0x7f470008de90 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f46f0003170 con 0x7f470008de90 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): dump: 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.401 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1733583863 0 0) 0x7f470013d310 con 0x7f470013efc0 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46d0003610 con 0x7f470013efc0 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f46f4003020 con 0x7f470013efc0 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient(hunting): dump: 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.402 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 client.?.objecter ms_handle_connect 0x7f470013faa0 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2976388710 0 0) 0x7f470012d9d0 con 0x7f470008de90 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.46:6789/0 conn(0x7f470013faa0 legacy=0x7f4700191600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.43:6789/0 conn(0x7f470013efc0 legacy=0x7f470012a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 monclient: found mon.c 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470008a680 con 0x7f470008de90 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 5 monclient: authenticate success, global_id 4397 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient: _renew_subs 2026-02-21T01:28:01.403 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f470012cb60 con 0x7f470008de90 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 client.4397.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient: _renew_subs 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f470012b6c0 con 0x7f470008de90 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46f0003540 con 0x7f470008de90 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4708616640 1 librados: init done 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f46f0004e80 con 0x7f470008de90 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f4704b88640 4 set_mon_vals no callback set 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.388+0000 7f46e6ffd640 10 monclient: dump: 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.404 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f4708616640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f47000582e0 con 0x7f47000882a0 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f46f0011800 con 0x7f470008de90 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 client.4397.objecter ms_handle_connect 0x7f47000882a0 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 client.4397.objecter resend_mon_ops 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f46f004dc50 con 0x7f470008de90 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 client.4397.objecter ms_dispatch2 0x7f4700000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 3 client.4397.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 3 client.4397.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 20 client.4397.objecter dump_active .. 0 homeless 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201720631 0 0) 0x7f46f4003540 con 0x7f47000882a0 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient(hunting): my global_id is 4400 2026-02-21T01:28:01.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f470012d9d0 con 0x7f47000882a0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1015795008 0 0) 0x7f470012d9d0 con 0x7f47000882a0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46f4003540 con 0x7f47000882a0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f46f4003aa0 con 0x7f47000882a0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient: dump: 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3067062550 0 0) 0x7f46f4003540 con 0x7f47000882a0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f470012c500 con 0x7f47000882a0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f4706b8c640 10 monclient: get_auth_request con 0x7f46d003eb50 auth_method 0 2026-02-21T01:28:01.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f46f4003cc0 con 0x7f47000882a0 2026-02-21T01:28:01.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:01.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.43:6790/0 conn(0x7f47000882a0 legacy=0x7f4700088670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.43:6790/0 conn(0x7f47000882a0 legacy=0x7f4700088670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:01.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.389+0000 7f46e6ffd640 10 client.4397.objecter ms_handle_connect 0x7f46d003eb50 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f47000891c0 con 0x7f4700088d80 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 client.4397.objecter ms_handle_connect 0x7f4700088d80 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 client.4397.objecter resend_mon_ops 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200640149 0 0) 0x7f47000891c0 con 0x7f4700088d80 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient(hunting): my global_id is 4403 2026-02-21T01:28:01.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46f4003540 con 0x7f4700088d80 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2657113191 0 0) 0x7f46f4003540 con 0x7f4700088d80 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47000891c0 con 0x7f4700088d80 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f46f40040f0 con 0x7f4700088d80 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient: dump: 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3381949062 0 0) 0x7f47000891c0 con 0x7f4700088d80 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4700093040 con 0x7f4700088d80 2026-02-21T01:28:01.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4315 (unknown 0 0 2682352100) 0x7f46f40053a0 con 0x7f4700088d80 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.43:6790/0 conn(0x7f4700088d80 legacy=0x7f4700193d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f46e6ffd640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.43:6790/0 conn(0x7f4700088d80 legacy=0x7f4700193d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 4, 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 17019, 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:28:01.410 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 16, 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.411 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.412 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:28:01.413 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:28:01.414 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:28:01.415 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.416 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:01.417 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:28:01.418 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 10 librados: watch_flush enter 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 10 librados: watch_flush exit 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 20 client.4397.objecter shutdown clearing up homeless session... 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 10 client.4397.objecter successfully canceled tick 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.46:6812/860801619 conn(0x7f46d003eb50 legacy=0x7f46d005f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 10 monclient: shutdown 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 >> v1:10.20.193.43:6790/0 conn(0x7f470008de90 legacy=0x7f4700129d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4706b8c640 1 -- 10.20.193.43:0/120788811 reap_dead start 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4706b8c640 1 -- 10.20.193.43:0/120788811 reap_dead start 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 shutdown_connections 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 >> 10.20.193.43:0/120788811 conn(0x7f4700093d40 msgr2=0x7f4700055f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.393+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 shutdown_connections 2026-02-21T01:28:01.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.394+0000 7f4708616640 1 -- 10.20.193.43:0/120788811 wait complete. 2026-02-21T01:28:01.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.394+0000 7f4708616640 1 librados: shutdown 2026-02-21T01:28:01.421 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:28:01.421 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:28:01.421 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:28:01.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.487+0000 7f4370ee1640 10 monclient: get_monmap_and_config 2026-02-21T01:28:01.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.487+0000 7f4370ee1640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.487+0000 7f4370ee1640 10 monclient: monmap: 2026-02-21T01:28:01.489 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:01.488115+0000 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:01.488115+0000 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:01.490 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 1 Processor -- start 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 1 -- start start 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient: init 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient(hunting): picked mon.noname-b con 0x7f436c08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient(hunting): picked mon.noname-a con 0x7f436c08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient(hunting): picked mon.noname-c con 0x7f436c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436c08a690 con 0x7f436c08d4d0 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436c08b910 con 0x7f436c08d8d0 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436c088ae0 con 0x7f436c08ddb0 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 10 monclient(hunting): authenticate will time out at 613.193554s 2026-02-21T01:28:01.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f436a575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f436c08ddb0 0x7f436c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:39286/0 (socket says 10.20.193.43:39286) 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369d74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f436c08d4d0 0x7f436c17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41480/0 (socket says 10.20.193.43:41480) 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f436a575640 1 -- 10.20.193.43:0/2627762532 learned_addr learned my addr 10.20.193.43:0/2627762532 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912313690 0 0) 0x7f436c08a690 con 0x7f436c08d4d0 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): my global_id is 4425 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4358003610 con 0x7f436c08d4d0 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583278251 0 0) 0x7f436c088ae0 con 0x7f436c08ddb0 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient(hunting): my global_id is 4406 2026-02-21T01:28:01.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f436c08a690 con 0x7f436c08ddb0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1786383943 0 0) 0x7f4358003610 con 0x7f436c08d4d0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 >> v1:10.20.193.43:6790/0 conn(0x7f436c08ddb0 legacy=0x7f436c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 >> v1:10.20.193.46:6789/0 conn(0x7f436c08d8d0 legacy=0x7f436c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 monclient: found mon.noname-a 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436c1a3ef0 con 0x7f436c08d4d0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4354002df0 con 0x7f436c08d4d0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 5 monclient: authenticate success, global_id 4425 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4369573640 10 monclient: dump: 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.498 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.488+0000 7f4370ee1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43540030f0 con 0x7f436c08d4d0 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4369573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4369573640 1 -- 10.20.193.43:0/2627762532 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4354003530 con 0x7f436c08d4d0 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4369573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4369573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4369573640 10 monclient: dump: 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.499 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 4 set_mon_vals no callback set 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 10 monclient: shutdown 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 -- 10.20.193.43:0/2627762532 >> v1:10.20.193.43:6789/0 conn(0x7f436c08d4d0 legacy=0x7f436c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 -- 10.20.193.43:0/2627762532 shutdown_connections 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 -- 10.20.193.43:0/2627762532 >> 10.20.193.43:0/2627762532 conn(0x7f436c08f480 msgr2=0x7f436c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 -- 10.20.193.43:0/2627762532 shutdown_connections 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 -- 10.20.193.43:0/2627762532 wait complete. 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 10 monclient: monmap: 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.500 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 librados: starting msgr at 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 librados: starting objecter 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 Processor -- start 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 -- start start 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 librados: setting wanted keys 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 1 librados: calling monclient init 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.489+0000 7f4370ee1640 10 monclient: init 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient(hunting): picked mon.noname-c con 0x7f436c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient(hunting): picked mon.noname-a con 0x7f436c08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient(hunting): picked mon.noname-b con 0x7f436c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436c139bf0 con 0x7f436c08d8d0 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436c125e50 con 0x7f436c08ddb0 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f436c124390 con 0x7f436c08d4d0 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient(hunting): authenticate will time out at 613.195140s 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4369d74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f436c08d8d0 0x7f436c123250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41488/0 (socket says 10.20.193.43:41488) 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f436a575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f436c08d4d0 0x7f436c122b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:39296/0 (socket says 10.20.193.43:39296) 2026-02-21T01:28:01.501 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4369d74640 1 -- 10.20.193.43:0/2860958822 learned_addr learned my addr 10.20.193.43:0/2860958822 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 client.?.objecter ms_handle_connect 0x7f436c08d8d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 client.?.objecter ms_handle_connect 0x7f436c08d4d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713153661 0 0) 0x7f436c139bf0 con 0x7f436c08d8d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): my global_id is 4428 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4338003610 con 0x7f436c08d8d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602890762 0 0) 0x7f436c124390 con 0x7f436c08d4d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): my global_id is 4409 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f436c139bf0 con 0x7f436c08d4d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 client.?.objecter ms_handle_connect 0x7f436c08ddb0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2204663991 0 0) 0x7f4338003610 con 0x7f436c08d8d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f436c124390 con 0x7f436c08d8d0 2026-02-21T01:28:01.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4354002db0 con 0x7f436c08d8d0 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): dump: 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 647145394 0 0) 0x7f436c139bf0 con 0x7f436c08d4d0 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4338003610 con 0x7f436c08d4d0 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f43600030b0 con 0x7f436c08d4d0 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient(hunting): dump: 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.503 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1690928421 0 0) 0x7f436c124390 con 0x7f436c08d8d0 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.43:6790/0 conn(0x7f436c08d4d0 legacy=0x7f436c122b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.46:6789/0 conn(0x7f436c08ddb0 legacy=0x7f436c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 monclient: found mon.a 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436c105b70 con 0x7f436c08d8d0 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 5 monclient: authenticate success, global_id 4428 2026-02-21T01:28:01.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient: _renew_subs 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f436c1266f0 con 0x7f436c08d8d0 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4354004d10 con 0x7f436c08d8d0 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4354005060 con 0x7f436c08d8d0 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4352ffd640 10 monclient: dump: 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4368d72640 4 set_mon_vals no callback set 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient: _renew_subs 2026-02-21T01:28:01.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f436c1250d0 con 0x7f436c08d8d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 1 librados: init done 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.490+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f436c08edd0 con 0x7f436c1a10d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f43540119e0 con 0x7f436c08d8d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f435404de10 con 0x7f436c08d8d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 client.4428.objecter ms_dispatch2 0x7f436c000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 3 client.4428.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 3 client.4428.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 20 client.4428.objecter dump_active .. 0 homeless 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f436ad76640 10 monclient: get_auth_request con 0x7f433803e930 auth_method 0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 client.4428.objecter ms_handle_connect 0x7f436c1a10d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 client.4428.objecter resend_mon_ops 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607508051 0 0) 0x7f436c08edd0 con 0x7f436c1a10d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 monclient(hunting): my global_id is 4339 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f436c124390 con 0x7f436c1a10d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 client.4428.objecter ms_handle_connect 0x7f433803e930 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3999468614 0 0) 0x7f436c124390 con 0x7f436c1a10d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f436c08edd0 con 0x7f436c1a10d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4360004a70 con 0x7f436c1a10d0 2026-02-21T01:28:01.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 10 monclient: dump: 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1396456556 0 0) 0x7f436c08edd0 con 0x7f436c1a10d0 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.491+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f436c0008d0 con 0x7f436c1a10d0 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.492+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f43600059c0 con 0x7f436c1a10d0 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.492+0000 7f4352ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.492+0000 7f4352ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.492+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.46:6789/0 conn(0x7f436c1a10d0 legacy=0x7f436c11ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.507 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.492+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.46:6789/0 conn(0x7f436c1a10d0 legacy=0x7f436c11ea50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.495+0000 7f4370ee1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.495+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f436c123ad0 con 0x7f436c11f160 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.495+0000 7f4352ffd640 10 client.4428.objecter ms_handle_connect 0x7f436c11f160 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.495+0000 7f4352ffd640 10 client.4428.objecter resend_mon_ops 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673706988 0 0) 0x7f436c123ad0 con 0x7f436c11f160 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient(hunting): my global_id is 4342 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f436c08edd0 con 0x7f436c11f160 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3978115581 0 0) 0x7f436c08edd0 con 0x7f436c11f160 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f436c123ad0 con 0x7f436c11f160 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4360004ee0 con 0x7f436c11f160 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient: dump: 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.509 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3447592459 0 0) 0x7f436c123ad0 con 0x7f436c11f160 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f436c123ca0 con 0x7f436c11f160 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4482 (unknown 0 0 626749255) 0x7f4360004ee0 con 0x7f436c11f160 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.46:6789/0 conn(0x7f436c11f160 legacy=0x7f436c12cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4352ffd640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.46:6789/0 conn(0x7f436c11f160 legacy=0x7f436c12cc70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 4, 2026-02-21T01:28:01.510 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 17090, 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 16, 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.511 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:01.512 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:28:01.513 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.514 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.515 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "num": 4 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:01.516 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:01.517 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:28:01.517 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:28:01.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 10 librados: watch_flush enter 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 10 librados: watch_flush exit 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 20 client.4428.objecter shutdown clearing up homeless session... 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 10 client.4428.objecter successfully canceled tick 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.46:6812/860801619 conn(0x7f433803e930 legacy=0x7f433805ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 10 monclient: shutdown 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 >> v1:10.20.193.43:6789/0 conn(0x7f436c08d8d0 legacy=0x7f436c123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f436ad76640 1 -- 10.20.193.43:0/2860958822 reap_dead start 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f436ad76640 1 -- 10.20.193.43:0/2860958822 reap_dead start 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 shutdown_connections 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 >> 10.20.193.43:0/2860958822 conn(0x7f436c08f480 msgr2=0x7f436c1a2740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 shutdown_connections 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 1 -- 10.20.193.43:0/2860958822 wait complete. 2026-02-21T01:28:01.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.496+0000 7f4370ee1640 1 librados: shutdown 2026-02-21T01:28:01.518 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:28:01.518 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-21T01:28:01.519 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-21T01:28:01.519 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-21T01:28:01.519 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-21T01:28:01.519 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-21T01:28:01.519 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:28:01.527 INFO:tasks.ceph.mon.c:Stopped 2026-02-21T01:28:01.527 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-21T01:28:01.528 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:28:01.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient: get_monmap_and_config 2026-02-21T01:28:01.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient: monmap: 2026-02-21T01:28:01.634 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.634 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.634 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:01.633514+0000 2026-02-21T01:28:01.634 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:01.633514+0000 2026-02-21T01:28:01.635 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.635 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.635 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.635 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:01.635 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:01.635 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 1 Processor -- start 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 1 -- start start 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient: init 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient(hunting): picked mon.noname-b con 0x7f986c08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient(hunting): picked mon.noname-c con 0x7f986c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient(hunting): picked mon.noname-a con 0x7f986c08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c08a690 con 0x7f986c08d8d0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c08b910 con 0x7f986c08d4d0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c088ae0 con 0x7f986c08ddb0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f9871f2c640 10 monclient(hunting): authenticate will time out at 613.338953s 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.633+0000 7f986b7fe640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f986c08ddb0 legacy=0x7f986c08e180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f986c08d8d0 0x7f986c19f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41520/0 (socket says 10.20.193.43:41520) 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986bfff640 1 -- 10.20.193.43:0/2952193604 learned_addr learned my addr 10.20.193.43:0/2952193604 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915681023 0 0) 0x7f986c08a690 con 0x7f986c08d8d0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient(hunting): my global_id is 4431 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9850003610 con 0x7f986c08d8d0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1316915329 0 0) 0x7f9850003610 con 0x7f986c08d8d0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 >> v1:10.20.193.43:6790/0 conn(0x7f986c08ddb0 legacy=0x7f986c08e180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 >> v1:10.20.193.46:6789/0 conn(0x7f986c08d4d0 legacy=0x7f986c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 monclient: found mon.noname-a 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c1a3ef0 con 0x7f986c08d8d0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9860003170 con 0x7f986c08d8d0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 5 monclient: authenticate success, global_id 4431 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: dump: 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9860003470 con 0x7f986c08d8d0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 1 -- 10.20.193.43:0/2952193604 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f98600038b0 con 0x7f986c08d8d0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 4 set_mon_vals no callback set 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f986a7fc640 10 monclient: dump: 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 10 monclient: shutdown 2026-02-21T01:28:01.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 1 -- 10.20.193.43:0/2952193604 >> v1:10.20.193.43:6789/0 conn(0x7f986c08d8d0 legacy=0x7f986c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 1 -- 10.20.193.43:0/2952193604 shutdown_connections 2026-02-21T01:28:01.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 1 -- 10.20.193.43:0/2952193604 >> 10.20.193.43:0/2952193604 conn(0x7f986c08f480 msgr2=0x7f986c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 1 -- 10.20.193.43:0/2952193604 shutdown_connections 2026-02-21T01:28:01.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.634+0000 7f9871f2c640 1 -- 10.20.193.43:0/2952193604 wait complete. 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient: build_initial_monmap 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient: monmap: 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 librados: starting msgr at 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 librados: starting objecter 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 Processor -- start 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 -- start start 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 librados: setting wanted keys 2026-02-21T01:28:01.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 librados: calling monclient init 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient: init 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient(hunting): picked mon.noname-a con 0x7f986c08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient(hunting): picked mon.noname-c con 0x7f986c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient(hunting): picked mon.noname-b con 0x7f986c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c12dac0 con 0x7f986c08d4d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c087380 con 0x7f986c08ddb0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c05cb00 con 0x7f986c08d8d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9871f2c640 10 monclient(hunting): authenticate will time out at 613.340601s 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f986affd640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f986c08d8d0 legacy=0x7f986c086c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f986b7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f986c08d4d0 0x7f986c086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41530/0 (socket says 10.20.193.43:41530) 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f986b7fe640 1 -- 10.20.193.43:0/2240467721 learned_addr learned my addr 10.20.193.43:0/2240467721 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 client.?.objecter ms_handle_connect 0x7f986c08d4d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2191231064 0 0) 0x7f986c12dac0 con 0x7f986c08d4d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): my global_id is 4434 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f983c003610 con 0x7f986c08d4d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 client.?.objecter ms_handle_connect 0x7f986c08ddb0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 764994244 0 0) 0x7f983c003610 con 0x7f986c08d4d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f986c12dac0 con 0x7f986c08d4d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9858004230 con 0x7f986c08d4d0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): dump: 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:01.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317758355 0 0) 0x7f986c087380 con 0x7f986c08ddb0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): _negotiate 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 10 monclient(hunting): my global_id is 4345 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f983c003610 con 0x7f986c08ddb0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.635+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3203363883 0 0) 0x7f986c12dac0 con 0x7f986c08d4d0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 >> v1:10.20.193.43:6790/0 conn(0x7f986c08d8d0 legacy=0x7f986c086c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 >> v1:10.20.193.46:6789/0 conn(0x7f986c08ddb0 legacy=0x7f986c18ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: _finish_hunting 0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 monclient: found mon.a 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c08c710 con 0x7f986c08d4d0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: _finish_auth 0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: _check_auth_tickets 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 5 monclient: authenticate success, global_id 4434 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 monclient: _renew_subs 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f986c088000 con 0x7f986c08d4d0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 client.4434.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 monclient: _renew_subs 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f986c12d7e0 con 0x7f986c08d4d0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 1 librados: init done 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98580044c0 con 0x7f986c08d4d0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9858004850 con 0x7f986c08d4d0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 monclient: dump: 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9869ffb640 4 set_mon_vals no callback set 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986c08edd0 con 0x7f986c08d4d0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f98580049f0 con 0x7f986c08d4d0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f985804dd80 con 0x7f986c08d4d0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 10 client.4434.objecter ms_dispatch2 0x7f986c000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 3 client.4434.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 3 client.4434.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f9847fff640 20 client.4434.objecter dump_active .. 0 homeless 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.636+0000 7f986affd640 10 monclient: get_auth_request con 0x7f983c03e9d0 auth_method 0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.637+0000 7f9847fff640 10 client.4434.objecter ms_handle_connect 0x7f983c03e9d0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.639+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f98580176f0 con 0x7f986c08d4d0 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.639+0000 7f9847fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:01.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.639+0000 7f9847fff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:01.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.788+0000 7f9871f2c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:28:01.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.788+0000 7f9871f2c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:01.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.788+0000 7f9871f2c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:01.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.788+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f986c054ff0 con 0x7f986c08d4d0 2026-02-21T01:28:01.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.788+0000 7f9847fff640 1 -- 10.20.193.43:0/2240467721 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 1724424921) 0x7f9858016ff0 con 0x7f986c08d4d0 2026-02-21T01:28:01.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.788+0000 7f9847fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:01.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.788+0000 7f9847fff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:01.791 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:28:01.792 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 10 librados: watch_flush enter 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 10 librados: watch_flush exit 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 20 client.4434.objecter shutdown clearing up homeless session... 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 10 client.4434.objecter successfully canceled tick 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 >> v1:10.20.193.46:6812/860801619 conn(0x7f983c03e9d0 legacy=0x7f983c05ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 10 monclient: shutdown 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 >> v1:10.20.193.43:6789/0 conn(0x7f986c08d4d0 legacy=0x7f986c086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 shutdown_connections 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 >> 10.20.193.43:0/2240467721 conn(0x7f986c08f480 msgr2=0x7f986c1a30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:01.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 shutdown_connections 2026-02-21T01:28:01.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 1 -- 10.20.193.43:0/2240467721 wait complete. 2026-02-21T01:28:01.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:01.789+0000 7f9871f2c640 1 librados: shutdown 2026-02-21T01:28:04.799 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:28:04.878 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 10 monclient: get_monmap_and_config 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 10 monclient: build_initial_monmap 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 10 monclient: monmap: 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:04.867611+0000 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:04.867611+0000 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:04.879 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 1 Processor -- start 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 1 -- start start 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 10 monclient: init 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:04.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.866+0000 7fb52257f640 10 monclient(hunting): picked mon.noname-a con 0x7fb51c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 10 monclient(hunting): picked mon.noname-b con 0x7fb51c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 10 monclient(hunting): picked mon.noname-c con 0x7fb51c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c08a690 con 0x7fb51c08ddb0 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c08b910 con 0x7fb51c08d8d0 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c088ae0 con 0x7fb51c08d4d0 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 10 monclient(hunting): authenticate will time out at 616.573046s 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51b7fe640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fb51c08d4d0 legacy=0x7fb51c17e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:04.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fb51c08ddb0 0x7fb51c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41536/0 (socket says 10.20.193.43:41536) 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51bfff640 1 -- 10.20.193.43:0/566919876 learned_addr learned my addr 10.20.193.43:0/566919876 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137411029 0 0) 0x7fb51c08a690 con 0x7fb51c08ddb0 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient(hunting): my global_id is 4437 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb500003610 con 0x7fb51c08ddb0 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 339535338 0 0) 0x7fb500003610 con 0x7fb51c08ddb0 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 >> v1:10.20.193.43:6790/0 conn(0x7fb51c08d4d0 legacy=0x7fb51c17e070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:04.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 >> v1:10.20.193.46:6789/0 conn(0x7fb51c08d8d0 legacy=0x7fb51c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 monclient: found mon.noname-a 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c1a3ef0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: _finish_auth 0 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 5 monclient: authenticate success, global_id 4437 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb508002df0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: dump: 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:04.884 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5080030f0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 1 -- 10.20.193.43:0/566919876 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb508003530 con 0x7fb51c08ddb0 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 4 set_mon_vals no callback set 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:04.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb51affd640 10 monclient: dump: 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:04.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 10 monclient: shutdown 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- 10.20.193.43:0/566919876 >> v1:10.20.193.43:6789/0 conn(0x7fb51c08ddb0 legacy=0x7fb51c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- 10.20.193.43:0/566919876 shutdown_connections 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- 10.20.193.43:0/566919876 >> 10.20.193.43:0/566919876 conn(0x7fb51c08f480 msgr2=0x7fb51c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- 10.20.193.43:0/566919876 shutdown_connections 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.867+0000 7fb52257f640 1 -- 10.20.193.43:0/566919876 wait complete. 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient: build_initial_monmap 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient: monmap: 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:04.887 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 librados: starting msgr at 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 librados: starting objecter 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 Processor -- start 2026-02-21T01:28:04.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 -- start start 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 librados: setting wanted keys 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 librados: calling monclient init 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient: init 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient(hunting): picked mon.noname-c con 0x7fb51c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient(hunting): picked mon.noname-b con 0x7fb51c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient(hunting): picked mon.noname-a con 0x7fb51c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c125cf0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c128ca0 con 0x7fb51c08d8d0 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c05b6f0 con 0x7fb51c08d4d0 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:04.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb51bfff640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fb51c08d4d0 legacy=0x7fb51c124ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb52257f640 10 monclient(hunting): authenticate will time out at 616.574890s 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb520af5640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fb51c08ddb0 0x7fb51c19b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41544/0 (socket says 10.20.193.43:41544) 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb520af5640 1 -- 10.20.193.43:0/814334516 learned_addr learned my addr 10.20.193.43:0/814334516 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb518ff9640 10 client.?.objecter ms_handle_connect 0x7fb51c08ddb0 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.868+0000 7fb518ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852301147 0 0) 0x7fb51c125cf0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): my global_id is 4440 2026-02-21T01:28:04.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ec003610 con 0x7fb51c08ddb0 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2245970420 0 0) 0x7fb4ec003610 con 0x7fb51c08ddb0 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb51c125cf0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb5100032d0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): dump: 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:04.891 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1645191232 0 0) 0x7fb51c125cf0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 >> v1:10.20.193.43:6790/0 conn(0x7fb51c08d4d0 legacy=0x7fb51c124ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 >> v1:10.20.193.46:6789/0 conn(0x7fb51c08d8d0 legacy=0x7fb51c1255e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 monclient: found mon.a 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:04.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c127e30 con 0x7fb51c08ddb0 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: _finish_auth 0 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 5 monclient: authenticate success, global_id 4440 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 monclient: _renew_subs 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c1286e0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 monclient: _renew_subs 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:04.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb51c1290c0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 1 librados: init done 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb510004d70 con 0x7fb51c08ddb0 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb510004f20 con 0x7fb51c08ddb0 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 10 monclient: dump: 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:04.894 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb51a7fc640 4 set_mon_vals no callback set 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c08edd0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.869+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fb5100050c0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.870+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7fb51004e100 con 0x7fb51c08ddb0 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.870+0000 7fb518ff9640 10 client.4440.objecter ms_dispatch2 0x7fb51c000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.870+0000 7fb518ff9640 3 client.4440.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.870+0000 7fb518ff9640 3 client.4440.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.870+0000 7fb518ff9640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.870+0000 7fb51bfff640 10 monclient: get_auth_request con 0x7fb4ec03e7e0 auth_method 0 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.870+0000 7fb518ff9640 10 client.4440.objecter ms_handle_connect 0x7fb4ec03e7e0 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.872+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb510017ad0 con 0x7fb51c08ddb0 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.872+0000 7fb518ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:04.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:04.872+0000 7fb518ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.020+0000 7fb52257f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.020+0000 7fb52257f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.020+0000 7fb52257f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.020+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb51c054ff0 con 0x7fb51c08ddb0 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.020+0000 7fb518ff9640 1 -- 10.20.193.43:0/814334516 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 2231415525) 0x7fb5100173d0 con 0x7fb51c08ddb0 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.020+0000 7fb518ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.020+0000 7fb518ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:05.023 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:28:05.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 10 librados: watch_flush enter 2026-02-21T01:28:05.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 10 librados: watch_flush exit 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 10 client.4440.objecter successfully canceled tick 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 >> v1:10.20.193.46:6812/860801619 conn(0x7fb4ec03e7e0 legacy=0x7fb4ec05ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 10 monclient: shutdown 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 >> v1:10.20.193.43:6789/0 conn(0x7fb51c08ddb0 legacy=0x7fb51c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 shutdown_connections 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 >> 10.20.193.43:0/814334516 conn(0x7fb51c08f480 msgr2=0x7fb51c120a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 shutdown_connections 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 1 -- 10.20.193.43:0/814334516 wait complete. 2026-02-21T01:28:05.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:05.021+0000 7fb52257f640 1 librados: shutdown 2026-02-21T01:28:08.032 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:28:08.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.098+0000 7f914cc9f640 10 monclient: get_monmap_and_config 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.098+0000 7f914cc9f640 10 monclient: build_initial_monmap 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.098+0000 7f914cc9f640 10 monclient: monmap: 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:08.099774+0000 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:08.099774+0000 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:08.103 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.098+0000 7f914cc9f640 1 Processor -- start 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.098+0000 7f914cc9f640 1 -- start start 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.098+0000 7f914cc9f640 10 monclient: init 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 10 monclient(hunting): picked mon.noname-c con 0x7f914808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 10 monclient(hunting): picked mon.noname-a con 0x7f914808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 10 monclient(hunting): picked mon.noname-b con 0x7f914808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:08.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914808a690 con 0x7f914808d4d0 2026-02-21T01:28:08.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914808b910 con 0x7f914808ddb0 2026-02-21T01:28:08.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148088ae0 con 0x7f914808d8d0 2026-02-21T01:28:08.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:08.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f914cc9f640 10 monclient(hunting): authenticate will time out at 619.805231s 2026-02-21T01:28:08.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f9146d76640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f914819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:08.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f9145d74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f914808d4d0 0x7f914817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:41556/0 (socket says 10.20.193.43:41556) 2026-02-21T01:28:08.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.099+0000 7f9145d74640 1 -- 10.20.193.43:0/1639651792 learned_addr learned my addr 10.20.193.43:0/1639651792 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:08.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.300+0000 7f9146d76640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f914819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:08.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:08.701+0000 7f9146d76640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f914819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:09.504 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:09.502+0000 7f9146d76640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f914819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient(hunting): tick 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 1 monclient(hunting): continuing hunt 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f914819f7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.46:6789/0 conn(0x7f914808ddb0 legacy=0x7f914808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6789/0 conn(0x7f914808d4d0 legacy=0x7f914817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f91240037b0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f914808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f914808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91481a3ef0 con 0x7f91240037b0 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148088ae0 con 0x7f914808ddb0 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912406a4a0 con 0x7f914808d8d0 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f912ffff640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.100+0000 7f9146d76640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:11.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.301+0000 7f9146d76640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:11.703+0000 7f9146d76640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:12.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:12.504+0000 7f9146d76640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:14.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient(hunting): tick 2026-02-21T01:28:14.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 1 monclient(hunting): continuing hunt 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.46:6789/0 conn(0x7f914808ddb0 legacy=0x7f9124045480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6789/0 conn(0x7f91240037b0 legacy=0x7f9124023bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f914808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f912406a760 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f914808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912406b740 con 0x7f912406a760 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912406a4a0 con 0x7f914808ddb0 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912406b4b0 con 0x7f914808d8d0 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f912ffff640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:14.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.100+0000 7f9146575640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:14.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.301+0000 7f9146575640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:14.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:14.702+0000 7f9146575640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:15.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.503+0000 7f9146575640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:15.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315817844 0 0) 0x7f912406b740 con 0x7f912406a760 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): _negotiate 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): my global_id is 4443 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9134003610 con 0x7f912406a760 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84152631 0 0) 0x7f912406a4a0 con 0x7f914808ddb0 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): _negotiate 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:15.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient(hunting): my global_id is 4348 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f912406b740 con 0x7f914808ddb0 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3310764576 0 0) 0x7f912406b740 con 0x7f914808ddb0 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6790/0 conn(0x7f914808d8d0 legacy=0x7f9124066c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.43:6789/0 conn(0x7f912406a760 legacy=0x7f912406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: _finish_hunting 0 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 monclient: found mon.noname-c 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9124004c50 con 0x7f914808ddb0 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: _finish_auth 0 2026-02-21T01:28:15.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: _check_auth_tickets 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f91380046d0 con 0x7f914808ddb0 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: dump: 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:15.835 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f914cc9f640 5 monclient: authenticate success, global_id 4348 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f914cc9f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9138004910 con 0x7f914808ddb0 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 1 -- 10.20.193.43:0/1639651792 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9138004d50 con 0x7f914808ddb0 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:28:15.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f9145573640 10 monclient: dump: 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:15.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f914cc9f640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.824+0000 7f914cc9f640 4 set_mon_vals no callback set 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 10 monclient: shutdown 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 -- 10.20.193.43:0/1639651792 >> v1:10.20.193.46:6789/0 conn(0x7f914808ddb0 legacy=0x7f9124045480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 -- 10.20.193.43:0/1639651792 shutdown_connections 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 -- 10.20.193.43:0/1639651792 >> 10.20.193.43:0/1639651792 conn(0x7f914808f480 msgr2=0x7f914808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 -- 10.20.193.43:0/1639651792 shutdown_connections 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 -- 10.20.193.43:0/1639651792 wait complete. 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 10 monclient: build_initial_monmap 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 10 monclient: monmap: 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:15.838 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 librados: starting msgr at 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 librados: starting objecter 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 Processor -- start 2026-02-21T01:28:15.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 -- start start 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 librados: setting wanted keys 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 1 librados: calling monclient init 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.825+0000 7f914cc9f640 10 monclient: init 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 10 monclient(hunting): picked mon.noname-b con 0x7f912406a760 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 10 monclient(hunting): picked mon.noname-a con 0x7f914808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 10 monclient(hunting): picked mon.noname-c con 0x7f914808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148139bc0 con 0x7f914808d8d0 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914805e1b0 con 0x7f912406a760 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148126280 con 0x7f914808ddb0 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:15.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f914cc9f640 10 monclient(hunting): authenticate will time out at 627.531150s 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f9146d76640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f914808ddb0 legacy=0x7f914819c010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f9145d74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f914808d8d0 0x7f914819a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:46342/0 (socket says 10.20.193.43:46342) 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f9145d74640 1 -- 10.20.193.43:0/3873624557 learned_addr learned my addr 10.20.193.43:0/3873624557 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 client.?.objecter ms_handle_connect 0x7f914808d8d0 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 client.?.objecter ms_handle_connect 0x7f912406a760 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802944869 0 0) 0x7f9148139bc0 con 0x7f914808d8d0 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:15.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): my global_id is 4446 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9114003610 con 0x7f914808d8d0 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059943601 0 0) 0x7f914805e1b0 con 0x7f912406a760 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): my global_id is 4351 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9148139bc0 con 0x7f912406a760 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3039897880 0 0) 0x7f9114003610 con 0x7f914808d8d0 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f914805e1b0 con 0x7f914808d8d0 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9130002f20 con 0x7f914808d8d0 2026-02-21T01:28:15.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): dump: 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:15.843 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.826+0000 7f912effd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4236479465 0 0) 0x7f914805e1b0 con 0x7f914808d8d0 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 >> v1:10.20.193.43:6790/0 conn(0x7f914808ddb0 legacy=0x7f914819c010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 >> v1:10.20.193.46:6789/0 conn(0x7f912406a760 legacy=0x7f9148112d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 monclient: found mon.a 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91481285e0 con 0x7f914808d8d0 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: _finish_auth 0 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:15.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 5 monclient: authenticate success, global_id 4446 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 monclient: _renew_subs 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9148127d40 con 0x7f914808d8d0 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 client.4446.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 monclient: _renew_subs 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f91481257d0 con 0x7f914808d8d0 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 1 librados: init done 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91300048d0 con 0x7f914808d8d0 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9130004ac0 con 0x7f914808d8d0 2026-02-21T01:28:15.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 monclient: dump: 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:15.846 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f9144d72640 4 set_mon_vals no callback set 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914808edd0 con 0x7f914808d8d0 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f9130004c60 con 0x7f914808d8d0 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7f913004dc50 con 0x7f914808d8d0 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 10 client.4446.objecter ms_dispatch2 0x7f9148000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 3 client.4446.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 3 client.4446.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.827+0000 7f912effd640 20 client.4446.objecter dump_active .. 0 homeless 2026-02-21T01:28:15.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.828+0000 7f9146575640 10 monclient: get_auth_request con 0x7f911403e930 auth_method 0 2026-02-21T01:28:15.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.828+0000 7f912effd640 10 client.4446.objecter ms_handle_connect 0x7f911403e930 2026-02-21T01:28:15.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.830+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9130017620 con 0x7f914808d8d0 2026-02-21T01:28:15.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.830+0000 7f912effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:15.848 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.830+0000 7f912effd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:15.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.981+0000 7f914cc9f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:28:15.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.981+0000 7f914cc9f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:15.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.981+0000 7f914cc9f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:15.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.981+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9148054ff0 con 0x7f914808d8d0 2026-02-21T01:28:15.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.981+0000 7f912effd640 1 -- 10.20.193.43:0/3873624557 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1459 (unknown 254746657 0 659621503) 0x7f913003a5c0 con 0x7f914808d8d0 2026-02-21T01:28:15.984 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.981+0000 7f912effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:28:15.985 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.981+0000 7f912effd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:15.985 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":8,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:28:15.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 10 librados: watch_flush enter 2026-02-21T01:28:15.986 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 10 librados: watch_flush exit 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 20 client.4446.objecter shutdown clearing up homeless session... 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 10 client.4446.objecter successfully canceled tick 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 >> v1:10.20.193.46:6812/860801619 conn(0x7f911403e930 legacy=0x7f911405ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 10 monclient: shutdown 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 >> v1:10.20.193.43:6789/0 conn(0x7f914808d8d0 legacy=0x7f914819a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 shutdown_connections 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 >> 10.20.193.43:0/3873624557 conn(0x7f914808f480 msgr2=0x7f914805a880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 shutdown_connections 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 1 -- 10.20.193.43:0/3873624557 wait complete. 2026-02-21T01:28:15.987 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:15.982+0000 7f914cc9f640 1 librados: shutdown 2026-02-21T01:28:15.993 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-21T01:28:15.993 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-21T01:28:15.994 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 10 monclient: get_monmap_and_config 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 10 monclient: build_initial_monmap 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 10 monclient: monmap: 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:16.060680+0000 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:16.060680+0000 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 1 Processor -- start 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 1 -- start start 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 10 monclient: init 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.060+0000 7fd95b26e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 10 monclient(hunting): picked mon.noname-b con 0x7fd95408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:16.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 10 monclient(hunting): picked mon.noname-a con 0x7fd95408d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 10 monclient(hunting): picked mon.noname-c con 0x7fd95408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95408a690 con 0x7fd95408d4d0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95408b910 con 0x7fd95408d8d0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd954088ae0 con 0x7fd95408ddb0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd958fe3640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fd95408ddb0 legacy=0x7fd95408e180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 10 monclient(hunting): authenticate will time out at 627.766070s 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd95408d4d0 0x7fd95417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:46358/0 (socket says 10.20.193.43:46358) 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94bfff640 1 -- 10.20.193.43:0/4245254277 learned_addr learned my addr 10.20.193.43:0/4245254277 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870373528 0 0) 0x7fd95408a690 con 0x7fd95408d4d0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient(hunting): my global_id is 4449 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd940003610 con 0x7fd95408d4d0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2758519830 0 0) 0x7fd940003610 con 0x7fd95408d4d0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 >> v1:10.20.193.43:6790/0 conn(0x7fd95408ddb0 legacy=0x7fd95408e180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 >> v1:10.20.193.46:6789/0 conn(0x7fd95408d8d0 legacy=0x7fd95419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 monclient: found mon.noname-a 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9541a3ef0 con 0x7fd95408d4d0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd93c002df0 con 0x7fd95408d4d0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: dump: 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.074 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 5 monclient: authenticate success, global_id 4449 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd93c0030f0 con 0x7fd95408d4d0 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 1 -- 10.20.193.43:0/4245254277 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd93c003530 con 0x7fd95408d4d0 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd94b7fe640 10 monclient: dump: 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 4 set_mon_vals no callback set 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 10 monclient: shutdown 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- 10.20.193.43:0/4245254277 >> v1:10.20.193.43:6789/0 conn(0x7fd95408d4d0 legacy=0x7fd95417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- 10.20.193.43:0/4245254277 shutdown_connections 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- 10.20.193.43:0/4245254277 >> 10.20.193.43:0/4245254277 conn(0x7fd95408f480 msgr2=0x7fd95408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- 10.20.193.43:0/4245254277 shutdown_connections 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.061+0000 7fd95b26e640 1 -- 10.20.193.43:0/4245254277 wait complete. 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient: build_initial_monmap 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient: monmap: 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:16.075 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 librados: starting msgr at 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 librados: starting objecter 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 Processor -- start 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 -- start start 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 librados: setting wanted keys 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 librados: calling monclient init 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient: init 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient(hunting): picked mon.noname-c con 0x7fd95408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient(hunting): picked mon.noname-b con 0x7fd95408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient(hunting): picked mon.noname-a con 0x7fd95408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9541299d0 con 0x7fd95408ddb0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95405e1b0 con 0x7fd95408d8d0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95405cb70 con 0x7fd95408d4d0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd95b26e640 10 monclient(hunting): authenticate will time out at 627.767658s 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd958fe3640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fd95408d4d0 legacy=0x7fd9541261c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9597e4640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd95408ddb0 0x7fd954126fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:46372/0 (socket says 10.20.193.43:46372) 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9597e4640 1 -- 10.20.193.43:0/1562477457 learned_addr learned my addr 10.20.193.43:0/1562477457 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 client.?.objecter ms_handle_connect 0x7fd95408ddb0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031572855 0 0) 0x7fd9541299d0 con 0x7fd95408ddb0 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): my global_id is 4452 2026-02-21T01:28:16.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd924003610 con 0x7fd95408ddb0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1091023243 0 0) 0x7fd924003610 con 0x7fd95408ddb0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9541299d0 con 0x7fd95408ddb0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd9500043d0 con 0x7fd95408ddb0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): dump: 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.062+0000 7fd9497fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3234527476 0 0) 0x7fd9541299d0 con 0x7fd95408ddb0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.43:6790/0 conn(0x7fd95408d4d0 legacy=0x7fd9541261c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.46:6789/0 conn(0x7fd95408d8d0 legacy=0x7fd9541268d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: _finish_hunting 0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 monclient: found mon.a 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd954129f90 con 0x7fd95408ddb0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: _finish_auth 0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: _check_auth_tickets 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 5 monclient: authenticate success, global_id 4452 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 10 monclient: _renew_subs 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9541296f0 con 0x7fd95408ddb0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 10 monclient: _renew_subs 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.077 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd95419c910 con 0x7fd95408ddb0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 1 librados: init done 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd950002a50 con 0x7fd95408ddb0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd950002c80 con 0x7fd95408ddb0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: dump: 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd94affd640 4 set_mon_vals no callback set 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd95408edd0 con 0x7fd9541a10d0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 client.4452.objecter ms_handle_connect 0x7fd9541a10d0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 client.4452.objecter resend_mon_ops 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fd950002e20 con 0x7fd95408ddb0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499893926 0 0) 0x7fd95408edd0 con 0x7fd9541a10d0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient(hunting): my global_id is 4455 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9541299d0 con 0x7fd9541a10d0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7fd95004e020 con 0x7fd95408ddb0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 client.4452.objecter ms_dispatch2 0x7fd954000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 3 client.4452.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 3 client.4452.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 20 client.4452.objecter dump_active .. 0 homeless 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2284070417 0 0) 0x7fd9541299d0 con 0x7fd9541a10d0 2026-02-21T01:28:16.078 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd95408edd0 con 0x7fd9541a10d0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd944003fc0 con 0x7fd9541a10d0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.063+0000 7fd9497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 10 monclient: dump: 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd94bfff640 10 monclient: get_auth_request con 0x7fd92403e7e0 auth_method 0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3836503043 0 0) 0x7fd95408edd0 con 0x7fd9541a10d0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9540008d0 con 0x7fd9541a10d0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 10 client.4452.objecter ms_handle_connect 0x7fd92403e7e0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd944006330 con 0x7fd9541a10d0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.43:6789/0 conn(0x7fd9541a10d0 legacy=0x7fd9540876e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.064+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.43:6789/0 conn(0x7fd9541a10d0 legacy=0x7fd9540876e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd95b26e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd954129dc0 con 0x7fd95404ca30 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 client.4452.objecter ms_handle_connect 0x7fd95404ca30 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 client.4452.objecter resend_mon_ops 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583435190 0 0) 0x7fd954129dc0 con 0x7fd95404ca30 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient(hunting): my global_id is 4458 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd95408edd0 con 0x7fd95404ca30 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 318953463 0 0) 0x7fd95408edd0 con 0x7fd95404ca30 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd954129dc0 con 0x7fd95404ca30 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd944004650 con 0x7fd95404ca30 2026-02-21T01:28:16.079 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient: dump: 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 562791417 0 0) 0x7fd954129dc0 con 0x7fd95404ca30 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd95412fc10 con 0x7fd95404ca30 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4305 (unknown 0 0 1108274251) 0x7fd944005bb0 con 0x7fd95404ca30 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.43:6789/0 conn(0x7fd95404ca30 legacy=0x7fd95412d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.067+0000 7fd9497fa640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.43:6789/0 conn(0x7fd95404ca30 legacy=0x7fd95412d4e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 8, 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 31697, 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:28:16.080 INFO:teuthology.orchestra.run.trial043.stdout: 1 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:16.081 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.082 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:28:16.083 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:28:16.084 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 10 librados: watch_flush enter 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 10 librados: watch_flush exit 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 20 client.4452.objecter shutdown clearing up homeless session... 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 10 client.4452.objecter successfully canceled tick 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.46:6812/860801619 conn(0x7fd92403e7e0 legacy=0x7fd92405ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 10 monclient: shutdown 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 >> v1:10.20.193.43:6789/0 conn(0x7fd95408ddb0 legacy=0x7fd954126fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd9597e4640 1 -- 10.20.193.43:0/1562477457 reap_dead start 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd9597e4640 1 -- 10.20.193.43:0/1562477457 reap_dead start 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 shutdown_connections 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 >> 10.20.193.43:0/1562477457 conn(0x7fd95408f480 msgr2=0x7fd9541a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 shutdown_connections 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 1 -- 10.20.193.43:0/1562477457 wait complete. 2026-02-21T01:28:16.086 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.068+0000 7fd95b26e640 1 librados: shutdown 2026-02-21T01:28:16.086 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:28:16.086 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-21T01:28:16.086 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:28:16.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.151+0000 7fdd24ce8640 10 monclient: get_monmap_and_config 2026-02-21T01:28:16.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.151+0000 7fdd24ce8640 10 monclient: build_initial_monmap 2026-02-21T01:28:16.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.151+0000 7fdd24ce8640 10 monclient: monmap: 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:28:16.151995+0000 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:28:16.151995+0000 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:28:16.154 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 1 Processor -- start 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 1 -- start start 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient: init 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient(hunting): picked mon.noname-b con 0x7fdd2008ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient(hunting): picked mon.noname-a con 0x7fdd2008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient(hunting): picked mon.noname-c con 0x7fdd2008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2008a690 con 0x7fdd2008d4d0 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2008b910 con 0x7fdd2008d8d0 2026-02-21T01:28:16.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd20088ae0 con 0x7fdd2008ddb0 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1e575640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fdd2008ddb0 legacy=0x7fdd2008e180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient(hunting): authenticate will time out at 627.857416s 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1dd74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fdd2008d4d0 0x7fdd2017e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:46396/0 (socket says 10.20.193.43:46396) 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1dd74640 1 -- 10.20.193.43:0/638949436 learned_addr learned my addr 10.20.193.43:0/638949436 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002574954 0 0) 0x7fdd2008a690 con 0x7fdd2008d4d0 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient(hunting): my global_id is 4461 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd0c003610 con 0x7fdd2008d4d0 2026-02-21T01:28:16.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1162955111 0 0) 0x7fdd0c003610 con 0x7fdd2008d4d0 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 >> v1:10.20.193.43:6790/0 conn(0x7fdd2008ddb0 legacy=0x7fdd2008e180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 >> v1:10.20.193.46:6789/0 conn(0x7fdd2008d8d0 legacy=0x7fdd2019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: _finish_hunting 0 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 monclient: found mon.noname-a 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd201a3ef0 con 0x7fdd2008d4d0 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: _finish_auth 0 2026-02-21T01:28:16.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: _check_auth_tickets 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fdd08002df0 con 0x7fdd2008d4d0 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: dump: 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.163 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 5 monclient: authenticate success, global_id 4461 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd080030f0 con 0x7fdd2008d4d0 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 1 -- 10.20.193.43:0/638949436 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fdd08003530 con 0x7fdd2008d4d0 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd1d573640 10 monclient: dump: 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.164 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 10 monclient: get_monmap_and_config success 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.152+0000 7fdd24ce8640 4 set_mon_vals no callback set 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 10 monclient: shutdown 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 -- 10.20.193.43:0/638949436 >> v1:10.20.193.43:6789/0 conn(0x7fdd2008d4d0 legacy=0x7fdd2017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 -- 10.20.193.43:0/638949436 shutdown_connections 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 -- 10.20.193.43:0/638949436 >> 10.20.193.43:0/638949436 conn(0x7fdd2008f480 msgr2=0x7fdd2008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 -- 10.20.193.43:0/638949436 shutdown_connections 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 -- 10.20.193.43:0/638949436 wait complete. 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 10 monclient: build_initial_monmap 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 10 monclient: monmap: 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:28:16.165 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 librados: starting msgr at 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 librados: starting objecter 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 Processor -- start 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 -- start start 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 librados: setting wanted keys 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 1 librados: calling monclient init 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 10 monclient: init 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.153+0000 7fdd24ce8640 10 monclient: _reopen_session rank -1 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient(hunting): picked mon.noname-c con 0x7fdd2008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient(hunting): picked mon.noname-a con 0x7fdd2008d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:16.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient(hunting): picked mon.noname-b con 0x7fdd2008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd201081e0 con 0x7fdd2008d8d0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd1e575640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fdd2008d4d0 legacy=0x7fdd2011dd80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd201084c0 con 0x7fdd2008ddb0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2005e1b0 con 0x7fdd2008d4d0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient(hunting): _renew_subs 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient(hunting): authenticate will time out at 627.859051s 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd1dd74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fdd2008d8d0 0x7fdd20191b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:46406/0 (socket says 10.20.193.43:46406) 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd1dd74640 1 -- 10.20.193.43:0/4030054264 learned_addr learned my addr 10.20.193.43:0/4030054264 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 client.?.objecter ms_handle_connect 0x7fdd2008d8d0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 208647496 0 0) 0x7fdd201081e0 con 0x7fdd2008d8d0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): my global_id is 4464 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcec003610 con 0x7fdd2008d8d0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1825244185 0 0) 0x7fdcec003610 con 0x7fdd2008d8d0 2026-02-21T01:28:16.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd201081e0 con 0x7fdd2008d8d0 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fdd08002c10 con 0x7fdd2008d8d0 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): dump: 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 735283508 0 0) 0x7fdd201081e0 con 0x7fdd2008d8d0 2026-02-21T01:28:16.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.43:6790/0 conn(0x7fdd2008d4d0 legacy=0x7fdd2011dd80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.46:6789/0 conn(0x7fdd2008ddb0 legacy=0x7fdd20193270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 monclient: found mon.a 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd20057410 con 0x7fdd2008d8d0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: _finish_auth 0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 client.?.objecter ms_handle_connect 0x7fdd2008ddb0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 5 monclient: authenticate success, global_id 4464 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient: _renew_subs 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd20107f00 con 0x7fdd2008d8d0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 client.4464.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient: _renew_subs 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd08004dd0 con 0x7fdd2008d8d0 2026-02-21T01:28:16.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd2011e490 con 0x7fdd2008d8d0 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 1 librados: init done 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fdd08005120 con 0x7fdd2008d8d0 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd1cd72640 4 set_mon_vals no callback set 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 10 monclient: dump: 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.170 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fdd08011aa0 con 0x7fdd2008d8d0 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.154+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd2008edd0 con 0x7fdd201a10d0 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7fdd0804dee0 con 0x7fdd2008d8d0 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 client.4464.objecter ms_dispatch2 0x7fdd20000b90 osd_map(20..20 src has 1..20) 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 3 client.4464.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 3 client.4464.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 20 client.4464.objecter dump_active .. 0 homeless 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 client.4464.objecter ms_handle_connect 0x7fdd201a10d0 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 client.4464.objecter resend_mon_ops 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd1ed76640 10 monclient: get_auth_request con 0x7fdcec03e7b0 auth_method 0 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086851297 0 0) 0x7fdd2008edd0 con 0x7fdd201a10d0 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 monclient(hunting): my global_id is 4354 2026-02-21T01:28:16.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd201081e0 con 0x7fdd201a10d0 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 994584208 0 0) 0x7fdd201081e0 con 0x7fdd201a10d0 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd2008edd0 con 0x7fdd201a10d0 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fdd14004000 con 0x7fdd201a10d0 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 monclient: dump: 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 10 client.4464.objecter ms_handle_connect 0x7fdcec03e7b0 2026-02-21T01:28:16.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1499397230 0 0) 0x7fdd2008edd0 con 0x7fdd201a10d0 2026-02-21T01:28:16.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.155+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd200008d0 con 0x7fdd201a10d0 2026-02-21T01:28:16.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.156+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fdd14005400 con 0x7fdd201a10d0 2026-02-21T01:28:16.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.156+0000 7fdd06ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:28:16.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.156+0000 7fdd06ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:28:16.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.156+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.46:6789/0 conn(0x7fdd201a10d0 legacy=0x7fdd200595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.156+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.46:6789/0 conn(0x7fdd201a10d0 legacy=0x7fdd200595c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:16.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.159+0000 7fdd24ce8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:28:16.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.159+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd2004d140 con 0x7fdd200876e0 2026-02-21T01:28:16.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 client.4464.objecter ms_handle_connect 0x7fdd200876e0 2026-02-21T01:28:16.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 client.4464.objecter resend_mon_ops 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613039565 0 0) 0x7fdd2004d140 con 0x7fdd200876e0 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 monclient(hunting): my global_id is 4357 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2008edd0 con 0x7fdd200876e0 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1093215870 0 0) 0x7fdd2008edd0 con 0x7fdd200876e0 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd2004d140 con 0x7fdd200876e0 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fdd14004660 con 0x7fdd200876e0 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 10 monclient: dump: 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:28:16.175 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.160+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3164948604 0 0) 0x7fdd2004d140 con 0x7fdd200876e0 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd201a0130 con 0x7fdd200876e0 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4470 (unknown 0 0 3520656572) 0x7fdd14004700 con 0x7fdd200876e0 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd06ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd06ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.46:6789/0 conn(0x7fdd200876e0 legacy=0x7fdd2004ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd06ffd640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.46:6789/0 conn(0x7fdd200876e0 legacy=0x7fdd2004ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:28:16.176 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 8, 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 31755, 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: 1 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:16.177 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:16.178 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:16.179 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:28:16.180 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.181 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.182 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:28:16.183 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.184 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:28:16.185 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 10 librados: watch_flush enter 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 10 librados: watch_flush exit 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 20 client.4464.objecter shutdown clearing up homeless session... 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 10 client.4464.objecter successfully canceled tick 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.46:6812/860801619 conn(0x7fdcec03e7b0 legacy=0x7fdcec05ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 10 monclient: shutdown 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 >> v1:10.20.193.43:6789/0 conn(0x7fdd2008d8d0 legacy=0x7fdd20191b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd1ed76640 1 -- 10.20.193.43:0/4030054264 reap_dead start 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd1ed76640 1 -- 10.20.193.43:0/4030054264 reap_dead start 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 shutdown_connections 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 >> 10.20.193.43:0/4030054264 conn(0x7fdd2008f480 msgr2=0x7fdd2011f210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 shutdown_connections 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 1 -- 10.20.193.43:0/4030054264 wait complete. 2026-02-21T01:28:16.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:28:16.161+0000 7fdd24ce8640 1 librados: shutdown 2026-02-21T01:28:16.188 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:28:16.188 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:Note: switching to '36d388f27052dd940bdbaf543bb05bdba0acc155'. 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:state without impacting any branches by switching back to a branch. 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: git switch -c 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:Or undo this operation with: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: git switch - 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr: 2026-02-21T01:28:21.763 INFO:tasks.workunit.client.0.trial046.stderr:HEAD is now at 36d388f2705 Merge branch 'aclamk-rocksdb-binned-cache-perf-counters-tentacle' of https://github.com/aclamk/ceph into wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-21T01:28:21.770 DEBUG:teuthology.orchestra.run.trial046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-21T01:28:21.828 INFO:tasks.workunit.client.0.trial046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-21T01:28:21.830 INFO:tasks.workunit.client.0.trial046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-21T01:28:21.830 INFO:tasks.workunit.client.0.trial046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-21T01:28:21.918 INFO:tasks.workunit.client.0.trial046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-21T01:28:21.948 INFO:tasks.workunit.client.0.trial046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-21T01:28:21.973 INFO:tasks.workunit.client.0.trial046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-21T01:28:21.975 INFO:tasks.workunit.client.0.trial046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-21T01:28:21.975 INFO:tasks.workunit.client.0.trial046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-21T01:28:21.998 INFO:tasks.workunit.client.0.trial046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-21T01:28:22.002 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-21T01:28:22.002 DEBUG:teuthology.orchestra.run.trial046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-21T01:28:22.059 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-21T01:28:22.061 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-21T01:28:22.061 DEBUG:teuthology.orchestra.run.trial046:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36d388f27052dd940bdbaf543bb05bdba0acc155 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ parallel=1 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' '' = --serial ']' 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ crimson=0 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' '' = --crimson ']' 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ color= 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -t 1 ']' 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ declare -A pids 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_aio 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_aio' 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_aio 2026-02-21T01:28:22.121 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_aio 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=44978 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_aio on pid 44978' 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stdout:test api_aio on pid 44978 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=44978 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.122 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_aio_pp 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_aio_pp' 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_aio_pp 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.123 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.124 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_aio_pp 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=44986 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_aio_pp on pid 44986' 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stdout:test api_aio_pp on pid 44986 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=44986 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_io 2026-02-21T01:28:22.125 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_io' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_io 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.126 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_io 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=44995 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stdout:test api_io on pid 44995 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_io on pid 44995' 2026-02-21T01:28:22.127 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=44995 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_io_pp 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_io_pp' 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_io_pp 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.128 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.129 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.130 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_io_pp 2026-02-21T01:28:22.130 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45006 2026-02-21T01:28:22.130 INFO:tasks.workunit.client.0.trial046.stdout:test api_io_pp on pid 45006 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_io_pp on pid 45006' 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45006 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_asio 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_asio' 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.131 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_asio 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.132 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_asio 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45022 2026-02-21T01:28:22.133 INFO:tasks.workunit.client.0.trial046.stdout:test api_asio on pid 45022 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_asio on pid 45022' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45022 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_list 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_list' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.135 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_list 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/44978/exe ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.136 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/44978/exe 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_list 2026-02-21T01:28:22.137 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45040 2026-02-21T01:28:22.138 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_list on pid 45040' 2026-02-21T01:28:22.138 INFO:tasks.workunit.client.0.trial046.stdout:test api_list on pid 45040 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45040 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_lock 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.140 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_lock' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_aio: /' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_lock 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/44986/exe ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.141 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/44986/exe 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_lock 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45060 2026-02-21T01:28:22.142 INFO:tasks.workunit.client.0.trial046.stdout:test api_lock on pid 45060 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_lock on pid 45060' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45060 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_lock_pp 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/44995/exe ']' 2026-02-21T01:28:22.145 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_lock_pp' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_lock_pp 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/44995/exe 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.146 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.147 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_lock_pp 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45079 2026-02-21T01:28:22.148 INFO:tasks.workunit.client.0.trial046.stdout:test api_lock_pp on pid 45079 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_lock_pp on pid 45079' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45079 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_misc 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_io.log 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_misc' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_io: /' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.150 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_misc 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45006/exe ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.151 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45006/exe 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_misc 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45098 2026-02-21T01:28:22.152 INFO:tasks.workunit.client.0.trial046.stdout:test api_misc on pid 45098 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_misc on pid 45098' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45098 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_misc_pp 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_misc_pp' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_misc_pp 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.155 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45022/exe ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.156 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45022/exe 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_misc_pp 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45115 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_misc_pp on pid 45115' 2026-02-21T01:28:22.157 INFO:tasks.workunit.client.0.trial046.stdout:test api_misc_pp on pid 45115 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45115 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_pool 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_pool' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_pool 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.159 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_asio: /' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.160 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45040/exe ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45040/exe 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.161 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_pool 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45136 2026-02-21T01:28:22.162 INFO:tasks.workunit.client.0.trial046.stdout:test api_pool on pid 45136 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_pool on pid 45136' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45136 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_snapshots 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_snapshots' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_snapshots 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.164 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_list.log 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_list: /' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.165 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45060/exe ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45060/exe 2026-02-21T01:28:22.166 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.167 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_snapshots 2026-02-21T01:28:22.167 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45157 2026-02-21T01:28:22.167 INFO:tasks.workunit.client.0.trial046.stdout:test api_snapshots on pid 45157 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_snapshots on pid 45157' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45157 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_snapshots_pp 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_snapshots_pp' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_snapshots_pp 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.169 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_lock: /' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.170 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45079/exe ']' 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45079/exe 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_snapshots_pp 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45184 2026-02-21T01:28:22.171 INFO:tasks.workunit.client.0.trial046.stdout:test api_snapshots_pp on pid 45184 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_snapshots_pp on pid 45184' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45184 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_stat 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_stat' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.174 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_stat 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.175 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45098/exe ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45098/exe 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.176 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_stat 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45221 2026-02-21T01:28:22.177 INFO:tasks.workunit.client.0.trial046.stdout:test api_stat on pid 45221 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_stat on pid 45221' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45221 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_stat_pp 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.179 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.180 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_stat_pp' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45115/exe ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_misc: /' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45115/exe 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_stat_pp 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.181 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_stat_pp 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.182 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.183 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.183 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.183 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.183 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45263 2026-02-21T01:28:22.183 INFO:tasks.workunit.client.0.trial046.stdout:test api_stat_pp on pid 45263 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_stat_pp on pid 45263' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45263 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_watch_notify 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_watch_notify' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45136/exe ']' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.186 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_watch_notify 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45136/exe 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.187 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.188 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45157/exe ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_pool: /' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45157/exe 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_watch_notify 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45320 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_watch_notify on pid 45320' 2026-02-21T01:28:22.189 INFO:tasks.workunit.client.0.trial046.stdout:test api_watch_notify on pid 45320 2026-02-21T01:28:22.190 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45320 2026-02-21T01:28:22.190 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.190 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_watch_notify_pp 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_watch_notify_pp' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_watch_notify_pp 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.191 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45184/exe ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45184/exe 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [----------] Global test environment set-up. 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient: get_monmap_and_config 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient: build_initial_monmap 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient: monmap: 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: epoch 0 2026-02-21T01:28:22.192 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: last_changed 0.000000 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: created 0.000000 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: election_strategy: 1 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 1 Processor -- start 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 1 -- start start 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient: init 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient: _reopen_session rank -1 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient(hunting): picked mon.noname-b con 0x559f28b917c0 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient(hunting): picked mon.noname-c con 0x559f28ba8570 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient(hunting): picked mon.noname-a con 0x559f28ba8970 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559f28baa710 con 0x559f28ba8970 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559f28babeb0 con 0x559f28b917c0 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559f28ba8150 con 0x559f28ba8570 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient(hunting): _renew_subs 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.159+0000 7ff37cbbc880 10 monclient(hunting): authenticate will time out at 640.848969s 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff37a672640 1 --1- >> v1:10.20.193.46:6789/0 conn(0x559f28b917c0 0x559f28ba69d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.46:6789/0 says I am v1:10.20.193.46:53064/0 (socket says 10.20.193.46:53064) 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff37a672640 1 -- 10.20.193.46:0/1176236734 learned_addr learned my addr 10.20.193.46:0/1176236734 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff379e71640 1 -- 10.20.193.46:0/1176236734 >> v1:10.20.193.43:6790/0 conn(0x559f28ba8570 legacy=0x559f28c83a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996517615 0 0) 0x559f28babeb0 con 0x559f28b917c0 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient(hunting): _negotiate 2026-02-21T01:28:22.193 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient(hunting): my global_id is 4387 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff358001e10 con 0x559f28b917c0 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3857234763 0 0) 0x7ff358001e10 con 0x559f28b917c0 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 >> v1:10.20.193.43:6790/0 conn(0x559f28ba8570 legacy=0x559f28c83a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 >> v1:10.20.193.43:6789/0 conn(0x559f28ba8970 legacy=0x559f28ca51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: _finish_hunting 0 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 monclient: found mon.noname-b 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.46:6789/0 2026-02-21T01:28:22.194 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f28bae4a0 con 0x559f28b917c0 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: _finish_auth 0 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: _check_auth_tickets 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff3700017b0 con 0x559f28b917c0 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: dump: 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: epoch 1 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: election_strategy: 1 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff370001a40 con 0x559f28b917c0 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 1 -- 10.20.193.46:0/1176236734 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff370003230 con 0x559f28b917c0 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff378e6f640 10 monclient: dump: 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: epoch 1 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_watch_notify_pp 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45346 2026-02-21T01:28:22.195 INFO:tasks.workunit.client.0.trial046.stdout: test api_watch_notify_pp on pid 45346 2026-02-21T01:28:22.196 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_watch_notify_pp on pid 45346' 2026-02-21T01:28:22.196 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45346 2026-02-21T01:28:22.196 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.196 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.196 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-21T01:28:22.196 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_cmd 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_cmd' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_cmd 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: election_strategy: 1 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:22.197 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff37cbbc880 5 monclient: authenticate success, global_id 4387 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff37cbbc880 10 monclient: get_monmap_and_config success 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.160+0000 7ff37cbbc880 4 set_mon_vals no callback set 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 10 monclient: shutdown 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 -- 10.20.193.46:0/1176236734 >> v1:10.20.193.46:6789/0 conn(0x559f28b917c0 legacy=0x559f28ba69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 -- 10.20.193.46:0/1176236734 shutdown_connections 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 -- 10.20.193.46:0/1176236734 >> 10.20.193.46:0/1176236734 conn(0x559f28b07770 msgr2=0x559f28baac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 -- 10.20.193.46:0/1176236734 shutdown_connections 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 -- 10.20.193.46:0/1176236734 wait complete. 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 10 monclient: build_initial_monmap 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 10 monclient: monmap: 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: epoch 0 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: last_changed 0.000000 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: created 0.000000 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: election_strategy: 1 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 librados: starting msgr at 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 librados: starting objecter 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 Processor -- start 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 -- start start 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 librados: setting wanted keys 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 1 librados: calling monclient init 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.161+0000 7ff37cbbc880 10 monclient: init 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 10 monclient: _reopen_session rank -1 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 10 monclient(hunting): picked mon.noname-c con 0x559f28b917c0 addr v1:10.20.193.43:6790/0 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 10 monclient(hunting): picked mon.noname-a con 0x559f28ba8570 addr v1:10.20.193.43:6789/0 2026-02-21T01:28:22.198 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 10 monclient(hunting): picked mon.noname-b con 0x559f28ba8970 addr v1:10.20.193.46:6789/0 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559f28b905f0 con 0x559f28ba8570 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559f28b95d50 con 0x559f28ba8970 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559f28b97c70 con 0x559f28b917c0 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 10 monclient(hunting): _renew_subs 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37cbbc880 10 monclient(hunting): authenticate will time out at 640.851117s 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff37a672640 1 -- >> v1:10.20.193.43:6790/0 conn(0x559f28b917c0 legacy=0x559f28b94f30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff379e71640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x559f28ba8570 0x559f28b95640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.46:45332/0 (socket says 10.20.193.46:45332) 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 learned_addr learned my addr 10.20.193.46:0/177095123 (peer_addr_for_me v1:10.20.193.46:0/0) 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 client.?.objecter ms_handle_connect 0x559f28ba8570 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 client.?.objecter ms_handle_connect 0x559f28ba8970 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155973476 0 0) 0x559f28b95d50 con 0x559f28ba8970 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:28:22.199 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): my global_id is 4390 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff358001b60 con 0x559f28ba8970 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 72491059 0 0) 0x7ff358001b60 con 0x559f28ba8970 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x559f28b95d50 con 0x559f28ba8970 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff36c001930 con 0x559f28ba8970 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): dump: 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: epoch 1 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.200 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45221/exe ']' 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: election_strategy: 1 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:22.201 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.162+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1661619641 0 0) 0x559f28b95d50 con 0x559f28ba8970 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 >> v1:10.20.193.43:6790/0 conn(0x559f28b917c0 legacy=0x559f28b94f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 >> v1:10.20.193.43:6789/0 conn(0x559f28ba8570 legacy=0x559f28b95640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 monclient: found mon.b 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f28b98ae0 con 0x559f28ba8970 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 5 monclient: authenticate success, global_id 4390 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 monclient: _renew_subs 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x559f28b98240 con 0x559f28ba8970 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 client.4390.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 monclient: _renew_subs 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x559f28ba6400 con 0x559f28ba8970 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 1 librados: init done 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 librados: wait_for_osdmap waiting 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff36c001bc0 con 0x559f28ba8970 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff36c001fd0 con 0x559f28ba8970 2026-02-21T01:28:22.202 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45221/exe 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_cmd 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45377 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_cmd on pid 45377' 2026-02-21T01:28:22.203 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: got monmap 1 from mon.b (accortest api_cmd on pid 45377 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45377 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_cmd_pp 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_cmd_pp' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_cmd_pp 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.205 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.206 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_stat: /' 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_cmd_pp 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45404 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_cmd_pp on pid 45404' 2026-02-21T01:28:22.207 INFO:tasks.workunit.client.0.trial046.stdout:test api_cmd_pp on pid 45404 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45404 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_service 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45263/exe ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_service' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45263/exe 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_service 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.209 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.210 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_service 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45438 2026-02-21T01:28:22.211 INFO:tasks.workunit.client.0.trial046.stdout:test api_service on pid 45438 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_service on pid 45438' 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45438 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.213 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_service_pp 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_service_pp' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_service_pp 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.214 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45320/exe ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.215 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45320/exe 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_service_pp 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45479 2026-02-21T01:28:22.216 INFO:tasks.workunit.client.0.trial046.stdout:test api_service_pp on pid 45479 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_service_pp on pid 45479' 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45479 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_c_write_operations 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.218 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_c_write_operations' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.219 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_c_write_operations 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45346/exe ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45346/exe 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.220 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_c_write_operations 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45500 2026-02-21T01:28:22.221 INFO:tasks.workunit.client.0.trial046.stdout:test api_c_write_operations on pid 45500 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_c_write_operations on pid 45500' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45500 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s api_c_read_operations 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' api_c_read_operations' 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.225 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ echo api_c_read_operations 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45377/exe ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45377/exe 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.226 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.227 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45404/exe ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=api_c_read_operations 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45571 2026-02-21T01:28:22.228 INFO:tasks.workunit.client.0.trial046.stdout:test api_c_read_operations on pid 45571 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test api_c_read_operations on pid 45571' 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45571 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_cmd: /' 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45404/exe 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s list_parallel 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.230 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' list_parallel' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ echo list_parallel 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.231 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45438/exe ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45438/exe 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=list_parallel 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45619 2026-02-21T01:28:22.232 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-21T01:28:22.233 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test list_parallel on pid 45619' 2026-02-21T01:28:22.233 INFO:tasks.workunit.client.0.trial046.stdout:test list_parallel on pid 45619 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45619 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s open_pools_parallel 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.235 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' open_pools_parallel' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ echo open_pools_parallel 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.236 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-21T01:28:22.237 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_service.log 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_service: /' 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=open_pools_parallel 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45661 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test open_pools_parallel on pid 45661' 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.238 INFO:tasks.workunit.client.0.trial046.stdout:test open_pools_parallel on pid 45661 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45661 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45479/exe ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s delete_pools_parallel 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' delete_pools_parallel' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.241 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45479/exe 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ echo delete_pools_parallel 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.242 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45500/exe ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45500/exe 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=delete_pools_parallel 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.243 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.244 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.244 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45687 2026-02-21T01:28:22.244 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.244 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test delete_pools_parallel on pid 45687' 2026-02-21T01:28:22.244 INFO:tasks.workunit.client.0.trial046.stdout:test delete_pools_parallel on pid 45687 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45687 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s cls 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' cls' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ echo cls 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.246 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.247 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=cls 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45707 2026-02-21T01:28:22.248 INFO:tasks.workunit.client.0.trial046.stdout:test cls on pid 45707 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test cls on pid 45707' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45707 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s cmd 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' cmd' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45571/exe ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:++ echo cmd 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45571/exe 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.251 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.252 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45619/exe ']' 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45619/exe 2026-02-21T01:28:22.253 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=cmd 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45765 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test cmd on pid 45765' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.254 INFO:tasks.workunit.client.0.trial046.stdout:test cmd on pid 45765 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45765 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s handler_error 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' handler_error' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.256 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ echo handler_error 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.257 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=handler_error 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45799 2026-02-21T01:28:22.258 INFO:tasks.workunit.client.0.trial046.stdout:test handler_error on pid 45799 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test handler_error on pid 45799' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45799 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s io 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ list_parallel: /' 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.260 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' io' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ echo io 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45661/exe ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45661/exe 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.261 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.262 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=io 2026-02-21T01:28:22.263 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45822 2026-02-21T01:28:22.263 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test io on pid 45822' 2026-02-21T01:28:22.263 INFO:tasks.workunit.client.0.trial046.stdout:test io on pid 45822 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45822 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s ec_io 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' ec_io' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.265 INFO:tasks.workunit.client.0.trial046.stderr:++ echo ec_io 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45687/exe ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45687/exe 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.266 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=ec_io 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45855 2026-02-21T01:28:22.267 INFO:tasks.workunit.client.0.trial046.stdout:test ec_io on pid 45855 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test ec_io on pid 45855' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45855 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s list 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.269 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45707/exe ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' list' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45707/exe 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ echo list 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.270 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=list 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.271 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.272 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.272 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.272 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45877 2026-02-21T01:28:22.272 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.272 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.272 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.272 INFO:tasks.workunit.client.0.trial046.stdout:test list on pid 45877 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test list on pid 45877' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45877 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s ec_list 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_cls 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_cls.log 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' ec_list' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ cls: /' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ echo ec_list 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.274 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.275 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45765/exe ']' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=ec_list 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45905 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test ec_list on pid 45905' 2026-02-21T01:28:22.276 INFO:tasks.workunit.client.0.trial046.stdout:test ec_list on pid 45905 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45905 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45765/exe 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s misc 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' misc' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.278 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ echo misc 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.279 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.280 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_cmd 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45799/exe ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ cmd: /' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45799/exe 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=misc 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45962 2026-02-21T01:28:22.281 INFO:tasks.workunit.client.0.trial046.stdout:test misc on pid 45962 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test misc on pid 45962' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=45962 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.284 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s pool 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' pool' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_handler_error 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ handler_error: /' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ echo pool 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.285 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45822/exe ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.286 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45822/exe 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=pool 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46008 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test pool on pid 46008' 2026-02-21T01:28:22.287 INFO:tasks.workunit.client.0.trial046.stdout:test pool on pid 46008 2026-02-21T01:28:22.289 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=46008 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s read_operations 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' read_operations' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ echo read_operations 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.290 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_io 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_io.log 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ io: /' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.291 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45855/exe ']' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=read_operations 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46038 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test read_operations on pid 46038' 2026-02-21T01:28:22.292 INFO:tasks.workunit.client.0.trial046.stdout:test read_operations on pid 46038 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=46038 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45855/exe 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s snapshots 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.294 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' snapshots' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45877/exe ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ echo snapshots 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45877/exe 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.295 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=snapshots 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_ec_io 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.296 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.297 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.297 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.297 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ ec_io: /' 2026-02-21T01:28:22.297 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46082 2026-02-21T01:28:22.297 INFO:tasks.workunit.client.0.trial046.stdout:test snapshots on pid 46082 2026-02-21T01:28:22.298 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test snapshots on pid 46082' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=46082 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_list 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_list.log 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s watch_notify 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' watch_notify' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ echo watch_notify 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ list: /' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.299 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.300 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=watch_notify 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46128 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test watch_notify on pid 46128' 2026-02-21T01:28:22.301 INFO:tasks.workunit.client.0.trial046.stdout:test watch_notify on pid 46128 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=46128 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:++ printf %25s write_operations 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+ r=' write_operations' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:++ echo write_operations 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:++ awk '{print $1}' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.303 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.304 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45905/exe ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.305 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/45962/exe ']' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:+ ff=write_operations 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46193 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stderr:+ echo 'test write_operations on pid 46193' 2026-02-21T01:28:22.306 INFO:tasks.workunit.client.0.trial046.stdout:test write_operations on pid 46193 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+ pids[$f]=46193 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+ ret=0 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' 1 -eq 1 ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45022 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45905/exe 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45022 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/45962/exe 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.314 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -f /etc/bashrc ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+ . /etc/bashrc 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -z '' ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ BASHRCSOURCED=Y 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ shopt -q login_shell 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ umask 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' 0022 -eq 0 ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ SHELL=/bin/bash 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.315 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_misc 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_misc.log 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ misc: /' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_ec_list 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ ec_list: /' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.316 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'grep=grep --color=auto' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-21T01:28:22.317 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorls.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/46038/exe ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' '!' -t 0 ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ return 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ export S_COLORS=auto 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ S_COLORS=auto 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/46038/exe 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.318 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/46008/exe ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/46008/exe 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.319 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_read_operations 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ read_operations: /' 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.320 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_pool.log 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/46082/exe ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/46082/exe 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_pool 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ pool: /' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ prefix=/usr 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset prefix 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-21T01:28:22.321 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/gawk.sh 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/lang.sh 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/locale 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_snapshots 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.322 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/46128/exe ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ snapshots: /' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/46128/exe 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++++ export LANG=en_US.UTF-8 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++++ LANG=en_US.UTF-8 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ LANG=en_US.UTF-8 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ unset LANG_backup config 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n '' ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' dumb = linux ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/less.sh 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ for i in /etc/profile.d/*.sh 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ '[' '' ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ . /etc/profile.d/which2.sh 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ '[' -r /proc/46193/exe ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+++++ readlink /proc/46193/exe 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_watch_notify 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ watch_notify: /' 2026-02-21T01:28:22.323 INFO:tasks.workunit.client.0.trial046.stderr:++++ basename /usr/bin/bash 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+++ SHELLNAME=bash 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+++ case "$SHELLNAME" in 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_declare='declare -f' 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+++ which_opt=-f 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+++ export which_declare 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+++ export -f which 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:++ unset i 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:++ unset -f pathmunge 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+ export PATH 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+ unset rc 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+ ceph_test_neorados_write_operations 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-21T01:28:22.324 INFO:tasks.workunit.client.0.trial046.stderr:+ sed 's/^/ write_operations: /' 2026-02-21T01:28:22.843 INFO:tasks.workunit.client.0.trial046.stdout:ding to old e1) 2026-02-21T01:28:22.843 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 monclient: dump: 2026-02-21T01:28:22.843 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: epoch 1 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: election_strategy: 1 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff378e6f640 4 set_mon_vals no callback set 2026-02-21T01:28:22.844 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff36c002220 con 0x559f28ba8970 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 1054739254 0 0) 0x7ff36c04b5e0 con 0x559f28ba8970 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_map(20..20 src has 1..20) 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 3 client.4390.objecter handle_osd_map got epochs [20,20] > 0 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 3 client.4390.objecter handle_osd_map decoding full epoch 20 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff36b7fe640 20 client.4390.objecter dump_active .. 0 homeless 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 librados: wait_for_osdmap done waiting 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x559f28a92da0 con 0x559f28ba8970 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.163+0000 7ff37a672640 10 monclient: get_auth_request con 0x7ff35803d150 auth_method 0 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff36b7fe640 10 client.4390.objecter ms_handle_connect 0x7ff35803d150 2026-02-21T01:28:22.845 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7ff36c010c90 con 0x559f28ba8970 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff36b7fe640 10 monclient: handle_get_version_reply finishing 1 version 20 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff36bfff640 10 client.4390.objecter _get_latest_version latest 20, have it 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff37cbbc880 10 client.4390.objecter create_pool name=ceph_test_rados_api_asio 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff37cbbc880 10 client.4390.objecter pool_op_submit 1 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff37cbbc880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.164+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x559f28a17570 con 0x559f28ba8970 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v21) ==== 43+0+0 (unknown 1518372966 0 0) 0x7ff36c019f30 con 0x559f28ba8970 2026-02-21T01:28:22.846 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 pool_op_reply(tid 1 (0) Success v21) 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 10 client.4390.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v21) 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 10 client.4390.objecter have request 1 at 0x559f28b96b70 Op: create 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 20 client.4390.objecter waiting for client to reach epoch 21 before calling back 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 10 client.4390.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 10 monclient: _renew_subs 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=21}) -- 0x559f28b95d50 con 0x559f28ba8970 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.840+0000 7ff36b7fe640 10 client.4390.objecter done 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== mon.1 v1:10.20.193.46:6789/0 11 ==== osd_map(21..21 src has 1..21) ==== 13374+0+0 (unknown 18386544 0 0) 0x7ff36c04a520 con 0x559f28ba8970 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff36b7fe640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_map(21..21 src has 1..21) 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff36b7fe640 3 client.4390.objecter handle_osd_map got epochs [21,21] > 20 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff36b7fe640 3 client.4390.objecter handle_osd_map decoding incremental epoch 21 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff36b7fe640 20 client.4390.objecter dump_active .. 0 homeless 2026-02-21T01:28:23.895 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 10 librados: set snap read head -> 1 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 10 librados: writefull oid=exist nspace= 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28b972e0 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 2 osd.4 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 2 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 15 client.4390.objecter _send_op 2 to 7.1 on osd.4 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:2 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x559f28cd1270 con 0x559f28caf770 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.842+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.843+0000 7ff379e71640 10 monclient: get_auth_request con 0x559f28caf770 auth_method 0 2026-02-21T01:28:23.896 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:22.843+0000 7ff36b7fe640 10 client.4390.objecter ms_handle_connect 0x559f28caf770 2026-02-21T01:28:23.954 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 1 ==== osd_map(22..22 src has 1..22) ==== 7736+0+0 (unknown 4175453868 0 0) 0x7ff364003620 con 0x559f28caf770 2026-02-21T01:28:23.954 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_map(22..22 src has 1..22) 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 3 client.4390.objecter handle_osd_map got epochs [22,22] > 21 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 3 client.4390.objecter handle_osd_map decoding incremental epoch 22 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 10 client.4390.objecter checking op 2 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 20 client.4390.objecter dump_active .. 0 homeless 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.893+0000 7ff36b7fe640 20 client.4390.objecter 2 7.d3a59201 osd.4 exist [writefull 0~5 in=5b] 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 2 ==== osd_op_reply(2 exist [writefull 0~5] v22'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 1672188149 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(2 exist [writefull 0~5] v22'1 uv1 ondisk = 0) 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 2 ondisk uv 1 in 7.1 attempt 0 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 2 2026-02-21T01:28:23.955 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _finish_op 2 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 2 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 librados: Objecter returned from writefull r=0 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cae250 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 3 osd.4 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.956 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 3 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _send_op 3 to 7.1 on osd.4 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:3 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cae700 con 0x559f28caf770 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28caec10 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 4 osd.4 2026-02-21T01:28:23.958 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 4 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _send_op 4 to 7.1 on osd.4 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:4 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd1610 con 0x559f28caf770 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 472631335 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 3 ondisk uv 1 in 7.1 attempt 0 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 3 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _finish_op 3 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 3 2026-02-21T01:28:23.959 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 4 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2347777278 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 4 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 4 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _finish_op 4 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 4 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (0 ms) 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cae250 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.960 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 5 osd.4 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 5 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _send_op 5 to 7.1 on osd.4 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:5 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28caebf0 con 0x559f28caf770 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd19b0 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.961 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 6 osd.4 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 6 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _send_op 6 to 7.1 on osd.4 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:6 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd1e60 con 0x559f28caf770 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 472631335 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 5 ondisk uv 1 in 7.1 attempt 0 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 5 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _finish_op 5 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 5 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.962 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 6 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2347777278 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 6 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (0 ms) 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 6 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _finish_op 6 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 6 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd19b0 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 7 osd.4 2026-02-21T01:28:23.963 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 7 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _send_op 7 to 7.1 on osd.4 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:7 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cae250 con 0x559f28caf770 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd2200 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 8 osd.4 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 8 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 15 client.4390.objecter _send_op 8 to 7.1 on osd.4 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:8 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd26b0 con 0x559f28caf770 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.952+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.964 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 472631335 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 7 ondisk uv 1 in 7.1 attempt 0 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 7 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _finish_op 7 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 7 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 8 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2347777278 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 8 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 8 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _finish_op 8 2026-02-21T01:28:23.965 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 8 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd19b0 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 9 osd.4 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 9 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _send_op 9 to 7.1 on osd.4 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:9 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28d12b10 con 0x559f28caf770 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28d12eb0 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.966 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 10 osd.4 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 10 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _send_op 10 to 7.1 on osd.4 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:10 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28d13360 con 0x559f28caf770 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 9 ==== osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 472631335 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 9 ondisk uv 1 in 7.1 attempt 0 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.967 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 9 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _finish_op 9 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 9 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 10 ==== osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2347777278 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 10 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 10 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _finish_op 10 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 10 2026-02-21T01:28:23.968 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd2c00 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 11 osd.4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 11 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _send_op 11 to 7.1 on osd.4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:11 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd30b0 con 0x559f28caf770 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd3560 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 12 osd.4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 12 2026-02-21T01:28:23.969 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _send_op 12 to 7.1 on osd.4 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:12 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3a10 con 0x559f28caf770 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 11 ==== osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 472631335 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 11 ondisk uv 1 in 7.1 attempt 0 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 11 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _finish_op 11 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 11 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 12 ==== osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2347777278 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 12 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.970 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 12 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _finish_op 12 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 12 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (0 ms) 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd2c00 write_seq 1 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd2d10 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 13 osd.4 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 13 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 15 client.4390.objecter _send_op 13 to 7.1 on osd.4 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:13 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd4570 con 0x559f28caf770 2026-02-21T01:28:23.971 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.953+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 13 ==== osd_op_reply(13 exist [write 0~5] v22'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 1662904861 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(13 exist [write 0~5] v22'2 uv2 ondisk = 0) 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 13 ondisk uv 2 in 7.1 attempt 0 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 13 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 15 client.4390.objecter _finish_op 13 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (1 ms) 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 13 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd2c00 2026-02-21T01:28:23.972 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd31c0 write_seq 2 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd2d10 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 14 osd.4 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 14 2026-02-21T01:28:23.975 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 15 client.4390.objecter _send_op 14 to 7.1 on osd.4 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:14 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd4570 con 0x559f28caf770 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.955+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 14 ==== osd_op_reply(14 exist [write 0~5] v22'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 396186057 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(14 exist [write 0~5] v22'3 uv3 ondisk = 0) 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 14 ondisk uv 3 in 7.1 attempt 0 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 14 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 15 client.4390.objecter _finish_op 14 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (1 ms) 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 14 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd31c0 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd5920 write_seq 3 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd2d10 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.976 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 15 osd.4 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 15 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 15 client.4390.objecter _send_op 15 to 7.1 on osd.4 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:15 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd4570 con 0x559f28caf770 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.956+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 15 ==== osd_op_reply(15 exist [write 0~5] v22'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 1576141844 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(15 exist [write 0~5] v22'4 uv4 ondisk = 0) 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 15 ondisk uv 4 in 7.1 attempt 0 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 15 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 15 client.4390.objecter _finish_op 15 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 15 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd5920 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1 ms) 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-21T01:28:23.977 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd49f0 write_seq 4 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd2d10 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 16 osd.4 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 16 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 15 client.4390.objecter _send_op 16 to 7.1 on osd.4 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:16 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28d1afb0 con 0x559f28caf770 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.957+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 16 ==== osd_op_reply(16 exist [write 0~5] v22'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 695386048 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(16 exist [write 0~5] v22'5 uv5 ondisk = 0) 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 16 ondisk uv 5 in 7.1 attempt 0 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 16 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 15 client.4390.objecter _finish_op 16 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.978 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 16 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd49f0 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1 ms) 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28d1b3a0 write_seq 5 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 17 osd.4 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 17 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 15 client.4390.objecter _send_op 17 to 7.1 on osd.4 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:17 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.959+0000 7ff37cbbc880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 17 ==== osd_op_reply(17 exist [write 0~5] v22'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 3035853756 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(17 exist [write 0~5] v22'6 uv6 ondisk = 0) 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 17 ondisk uv 6 in 7.1 attempt 0 2026-02-21T01:28:23.979 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 17 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 15 client.4390.objecter _finish_op 17 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 17 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28d1b3a0 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (1 ms) 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 18 osd.4 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 18 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 15 client.4390.objecter _send_op 18 to 7.1 on osd.4 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:18 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd3560 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.980 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 19 osd.4 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 19 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 15 client.4390.objecter _send_op 19 to 7.1 on osd.4 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:19 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3a10 con 0x559f28caf770 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.960+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 18 ==== osd_op_reply(18 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1515721756 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(18 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 18 ondisk uv 6 in 7.1 attempt 0 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 18 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _finish_op 18 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 18 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 19 ==== osd_op_reply(19 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3866624710 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(19 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 19 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 19 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _finish_op 19 2026-02-21T01:28:23.981 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 19 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 20 osd.4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 20 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _send_op 20 to 7.1 on osd.4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:20 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd3560 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 21 osd.4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 21 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _send_op 21 to 7.1 on osd.4 2026-02-21T01:28:23.982 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:21 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3a10 con 0x559f28caf770 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 20 ==== osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1515721756 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 20 ondisk uv 6 in 7.1 attempt 0 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 20 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _finish_op 20 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 20 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 21 ==== osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3866624710 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 21 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 21 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _finish_op 21 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 21 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (0 ms) 2026-02-21T01:28:23.983 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd3e00 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 22 osd.4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 22 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _send_op 22 to 7.1 on osd.4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:22 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3560 con 0x559f28caf770 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 23 osd.4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 23 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 15 client.4390.objecter _send_op 23 to 7.1 on osd.4 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:23 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 22 ==== osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1515721756 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.984 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 22 ondisk uv 6 in 7.1 attempt 0 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 22 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _finish_op 22 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 22 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 23 ==== osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3866624710 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 23 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 23 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _finish_op 23 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 23 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.961+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd3e00 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 24 osd.4 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.985 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 24 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _send_op 24 to 7.1 on osd.4 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:24 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3560 con 0x559f28caf770 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 25 osd.4 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 25 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _send_op 25 to 7.1 on osd.4 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:25 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 24 ==== osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1515721756 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 24 ondisk uv 6 in 7.1 attempt 0 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 24 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _finish_op 24 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 24 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-21T01:28:23.986 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 25 ==== osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3866624710 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 25 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 25 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _finish_op 25 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 25 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 26 osd.4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 26 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _send_op 26 to 7.1 on osd.4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:26 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3560 con 0x559f28caf770 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd3a30 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 27 osd.4 2026-02-21T01:28:23.987 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 27 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _send_op 27 to 7.1 on osd.4 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:27 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3560 con 0x559f28caf770 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 26 ==== osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1515721756 0 3741568377) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 26 ondisk uv 6 in 7.1 attempt 0 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 5 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 26 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _finish_op 26 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 26 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 27 ==== osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3866624710 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 27 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 27 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _finish_op 27 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 27 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.988 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (0 ms) 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd3080 write_seq 6 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 28 osd.4 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 28 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 15 client.4390.objecter _send_op 28 to 7.1 on osd.4 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:28 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3560 con 0x559f28caf770 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.962+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 28 ==== osd_op_reply(28 exist [writefull 0~5] v22'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 1564770044 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(28 exist [writefull 0~5] v22'7 uv7 ondisk = 0) 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 28 ondisk uv 7 in 7.1 attempt 0 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 28 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 15 client.4390.objecter _finish_op 28 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 28 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd3080 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (0 ms) 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd43b0 write_seq 7 2026-02-21T01:28:23.989 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 29 osd.4 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 29 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 15 client.4390.objecter _send_op 29 to 7.1 on osd.4 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:29 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3560 con 0x559f28caf770 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.963+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 29 ==== osd_op_reply(29 exist [writefull 0~5] v22'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 3172626066 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(29 exist [writefull 0~5] v22'8 uv8 ondisk = 0) 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 29 ondisk uv 8 in 7.1 attempt 0 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (0 ms) 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 29 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 15 client.4390.objecter _finish_op 29 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 29 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd43b0 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd2ff0 write_seq 8 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.990 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 30 osd.4 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 30 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 15 client.4390.objecter _send_op 30 to 7.1 on osd.4 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:30 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.964+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 30 ==== osd_op_reply(30 exist [writefull 0~5] v22'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 3382367558 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(30 exist [writefull 0~5] v22'9 uv9 ondisk = 0) 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 30 ondisk uv 9 in 7.1 attempt 0 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 30 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 15 client.4390.objecter _finish_op 30 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 30 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd2ff0 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1 ms) 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd3560 write_seq 9 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 31 osd.4 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 31 2026-02-21T01:28:23.991 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 15 client.4390.objecter _send_op 31 to 7.1 on osd.4 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:31 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.965+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 31 ==== osd_op_reply(31 exist [writefull 0~5] v22'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 1411062074 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(31 exist [writefull 0~5] v22'10 uv10 ondisk = 0) 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 31 ondisk uv 10 in 7.1 attempt 0 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 31 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 15 client.4390.objecter _finish_op 31 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 31 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd3560 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd2ff0 write_seq 10 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cdaf90 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 32 osd.4 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 32 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 15 client.4390.objecter _send_op 32 to 7.1 on osd.4 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:32 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cdb440 con 0x559f28caf770 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.966+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 32 ==== osd_op_reply(32 exist [writefull 0~5] v22'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 547070702 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.992 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(32 exist [writefull 0~5] v22'11 uv11 ondisk = 0) 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 32 ondisk uv 11 in 7.1 attempt 0 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 32 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter _finish_op 32 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 32 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd2ff0 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (0 ms) 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cdaf90 linger_id 1 cookie 94142072729488 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 1 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter send_linger 1 register 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28cd3a30 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.993 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [notify cookie 94142072729488 in=17b] tid 33 osd.4 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 33 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter _send_op 33 to 7.1 on osd.4 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:33 7.1 7:8049a5cb:::exist:head [notify cookie 94142072729488 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd3ee0 con 0x559f28caf770 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28ae7da0 linger_id 2 cookie 94142070685088 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 2 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter send_linger 2 register 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae91e0 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.994 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94142070685088 in=17b] tid 34 osd.4 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 34 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 15 client.4390.objecter _send_op 34 to 7.1 on osd.4 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:34 7.1 7:855dde50:::noexist:head [notify cookie 94142070685088 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28ae9690 con 0x559f28caf770 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 33 ==== watch-notify(notify_complete (2) cookie 94142072729488 notify 94489280512 ret 0) ==== 42+0+8 (unknown 614208545 0 0) 0x7ff364009020 con 0x559f28caf770 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 watch-notify(notify_complete (2) cookie 94142072729488 notify 94489280512 ret 0) 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 34 ==== osd_op_reply(33 exist [notify cookie 94142072729488 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2519566189 0 757179215) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(33 exist [notify cookie 94142072729488 out=8b] v0'0 uv11 ondisk = 0) 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 33 ondisk uv 11 in 7.1 attempt 0 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 8 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 33 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter _finish_op 33 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 33 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff36bfff640 10 librados: operator() completed notify (linger op 0x559f28cdaf90), ec = system:0 2026-02-21T01:28:23.995 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff378e6f640 10 client.4390.objecter _linger_commit 1 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff378e6f640 10 client.4390.objecter _linger_commit notify_id=94489280512 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff378e6f640 10 librados: finish linger op 0x559f28cdaf90 acked (0) 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff378e6f640 20 client.4390.objecter _linger_cancel linger_id=1 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff378e6f640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff378e6f640 15 client.4390.objecter _session_linger_op_remove 4 1 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 35 ==== osd_op_reply(34 noexist [notify cookie 94142070685088] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3292228469 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(34 noexist [notify cookie 94142070685088] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 34 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 34 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter _finish_op 34 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 34 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff36bfff640 10 client.4390.objecter _linger_commit 2 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff36bfff640 10 librados: finish linger op 0x559f28ae7da0 acked (-2) 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff36bfff640 10 librados: operator() completed notify (linger op 0x559f28ae7da0), ec = osd:2 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff36bfff640 20 client.4390.objecter _linger_cancel linger_id=2 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff36bfff640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.996 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.967+0000 7ff36bfff640 15 client.4390.objecter _session_linger_op_remove 4 2 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (0 ms) 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cdaf90 linger_id 3 cookie 94142072729488 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 3 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter send_linger 3 register 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9a80 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [notify cookie 94142072729488 in=17b] tid 35 osd.4 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.997 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 35 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _send_op 35 to 7.1 on osd.4 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:35 7.1 7:8049a5cb:::exist:head [notify cookie 94142072729488 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd39a0 con 0x559f28caf770 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cd3de0 linger_id 4 cookie 94142072700384 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 4 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter send_linger 4 register 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae8db0 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94142072700384 in=17b] tid 36 osd.4 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 36 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _send_op 36 to 7.1 on osd.4 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:36 7.1 7:855dde50:::noexist:head [notify cookie 94142072700384 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28ae9260 con 0x559f28caf770 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 36 ==== watch-notify(notify_complete (2) cookie 94142072729488 notify 94489280513 ret 0) ==== 42+0+8 (unknown 2664683183 0 0) 0x7ff364009020 con 0x559f28caf770 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 watch-notify(notify_complete (2) cookie 94142072729488 notify 94489280513 ret 0) 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 37 ==== osd_op_reply(35 exist [notify cookie 94142072729488 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2519566189 0 1679679080) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(35 exist [notify cookie 94142072729488 out=8b] v0'0 uv11 ondisk = 0) 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 35 ondisk uv 11 in 7.1 attempt 0 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 8 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 35 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _finish_op 35 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:23.998 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 35 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 38 ==== osd_op_reply(36 noexist [notify cookie 94142072700384] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4089638383 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(36 noexist [notify cookie 94142072700384] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 36 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 36 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _finish_op 36 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 36 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: operator() completed notify (linger op 0x559f28cdaf90), ec = system:0 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 client.4390.objecter _linger_commit 3 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 client.4390.objecter _linger_commit notify_id=94489280513 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 client.4390.objecter _linger_commit 4 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: finish linger op 0x559f28cdaf90 acked (0) 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: finish linger op 0x559f28cd3de0 acked (-2) 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: operator() completed notify (linger op 0x559f28cd3de0), ec = osd:2 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter _linger_cancel linger_id=3 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 15 client.4390.objecter _session_linger_op_remove 4 3 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter _linger_cancel linger_id=4 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 15 client.4390.objecter _session_linger_op_remove 4 4 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (0 ms) 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cd3de0 linger_id 5 cookie 94142072700384 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 5 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter send_linger 5 register 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9a80 2026-02-21T01:28:23.999 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [notify cookie 94142072700384 in=17b] tid 37 osd.4 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 37 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _send_op 37 to 7.1 on osd.4 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:37 7.1 7:8049a5cb:::exist:head [notify cookie 94142072700384 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd39a0 con 0x559f28caf770 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cdaf90 linger_id 6 cookie 94142072729488 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 6 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter send_linger 6 register 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae8db0 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94142072729488 in=17b] tid 38 osd.4 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 38 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _send_op 38 to 7.1 on osd.4 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:38 7.1 7:855dde50:::noexist:head [notify cookie 94142072729488 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28ae9260 con 0x559f28caf770 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 39 ==== watch-notify(notify_complete (2) cookie 94142072700384 notify 94489280514 ret 0) ==== 42+0+8 (unknown 2642991843 0 0) 0x7ff364009020 con 0x559f28caf770 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 watch-notify(notify_complete (2) cookie 94142072700384 notify 94489280514 ret 0) 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 40 ==== osd_op_reply(37 exist [notify cookie 94142072700384 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3942284655 0 3210303745) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(37 exist [notify cookie 94142072700384 out=8b] v0'0 uv11 ondisk = 0) 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 37 ondisk uv 11 in 7.1 attempt 0 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 8 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 37 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _finish_op 37 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:24.000 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 37 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: operator() completed notify (linger op 0x559f28cd3de0), ec = system:0 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 client.4390.objecter _linger_commit 5 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 client.4390.objecter _linger_commit notify_id=94489280514 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: finish linger op 0x559f28cd3de0 acked (0) 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter _linger_cancel linger_id=5 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 15 client.4390.objecter _session_linger_op_remove 4 5 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 41 ==== osd_op_reply(38 noexist [notify cookie 94142072729488] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2400524269 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(38 noexist [notify cookie 94142072729488] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 38 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 38 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _finish_op 38 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 38 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 client.4390.objecter _linger_commit 6 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: finish linger op 0x559f28cdaf90 acked (-2) 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 10 librados: operator() completed notify (linger op 0x559f28cdaf90), ec = osd:2 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter _linger_cancel linger_id=6 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff378e6f640 15 client.4390.objecter _session_linger_op_remove 4 6 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (0 ms) 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cd3de0 linger_id 7 cookie 94142072700384 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 7 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter send_linger 7 register 2026-02-21T01:28:24.001 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae7da0 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [notify cookie 94142072700384 in=17b] tid 39 osd.4 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 39 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _send_op 39 to 7.1 on osd.4 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:39 7.1 7:8049a5cb:::exist:head [notify cookie 94142072700384 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd39a0 con 0x559f28caf770 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cdaf90 linger_id 8 cookie 94142072729488 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 8 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter send_linger 8 register 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9260 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94142072729488 in=17b] tid 40 osd.4 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 40 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 15 client.4390.objecter _send_op 40 to 7.1 on osd.4 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:40 7.1 7:855dde50:::noexist:head [notify cookie 94142072729488 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28ae9710 con 0x559f28caf770 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.968+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 42 ==== watch-notify(notify_complete (2) cookie 94142072700384 notify 94489280515 ret 0) ==== 42+0+8 (unknown 667359341 0 0) 0x7ff364009020 con 0x559f28caf770 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 watch-notify(notify_complete (2) cookie 94142072700384 notify 94489280515 ret 0) 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 43 ==== osd_op_reply(39 exist [notify cookie 94142072700384 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3942284655 0 4133823526) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(39 exist [notify cookie 94142072700384 out=8b] v0'0 uv11 ondisk = 0) 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 39 ondisk uv 11 in 7.1 attempt 0 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 8 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 39 2026-02-21T01:28:24.002 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _finish_op 39 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 39 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 44 ==== osd_op_reply(40 noexist [notify cookie 94142072729488] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2400524269 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(40 noexist [notify cookie 94142072729488] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 40 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 40 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _finish_op 40 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 40 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: operator() completed notify (linger op 0x559f28cd3de0), ec = system:0 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 client.4390.objecter _linger_commit 7 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 client.4390.objecter _linger_commit notify_id=94489280515 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 client.4390.objecter _linger_commit 8 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: finish linger op 0x559f28cd3de0 acked (0) 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: finish linger op 0x559f28cdaf90 acked (-2) 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: operator() completed notify (linger op 0x559f28cdaf90), ec = osd:2 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter _linger_cancel linger_id=7 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 15 client.4390.objecter _session_linger_op_remove 4 7 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter _linger_cancel linger_id=8 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 15 client.4390.objecter _session_linger_op_remove 4 8 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (0 ms) 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cdaf90 linger_id 9 cookie 94142072729488 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 9 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter send_linger 9 register 2026-02-21T01:28:24.003 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae7da0 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid exist '@7' '@7' [notify cookie 94142072729488 in=17b] tid 41 osd.4 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 41 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _send_op 41 to 7.1 on osd.4 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:41 7.1 7:8049a5cb:::exist:head [notify cookie 94142072729488 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd39a0 con 0x559f28caf770 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter linger_register info 0x559f28cd3d90 linger_id 10 cookie 94142072700304 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_linger_op_assign 4 10 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter send_linger 10 register 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9360 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94142072700304 in=17b] tid 42 osd.4 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 6 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 42 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _send_op 42 to 7.1 on osd.4 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:42 7.1 7:855dde50:::noexist:head [notify cookie 94142072700304 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28ae9920 con 0x559f28caf770 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 5 client.4390.objecter 2 in flight 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 45 ==== watch-notify(notify_complete (2) cookie 94142072729488 notify 94489280516 ret 0) ==== 42+0+8 (unknown 3330012155 0 0) 0x7ff364009020 con 0x559f28caf770 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 watch-notify(notify_complete (2) cookie 94142072729488 notify 94489280516 ret 0) 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 46 ==== osd_op_reply(41 exist [notify cookie 94142072729488 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2519566189 0 205267234) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(41 exist [notify cookie 94142072729488 out=8b] v0'0 uv11 ondisk = 0) 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 41 ondisk uv 11 in 7.1 attempt 0 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 8 2026-02-21T01:28:24.004 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 41 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _finish_op 41 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 7 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 41 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: operator() completed notify (linger op 0x559f28cdaf90), ec = system:0 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 client.4390.objecter _linger_commit 9 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 client.4390.objecter _linger_commit notify_id=94489280516 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: finish linger op 0x559f28cdaf90 acked (0) 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter _linger_cancel linger_id=9 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 15 client.4390.objecter _session_linger_op_remove 4 9 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 47 ==== osd_op_reply(42 noexist [notify cookie 94142072700304] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1681314180 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(42 noexist [notify cookie 94142072700304] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 42 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 42 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _finish_op 42 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 5 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 42 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 client.4390.objecter _linger_commit 10 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: finish linger op 0x559f28cd3d90 acked (-2) 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 10 librados: operator() completed notify (linger op 0x559f28cd3d90), ec = osd:2 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter _linger_cancel linger_id=10 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff36bfff640 15 client.4390.objecter _session_linger_op_remove 4 10 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (0 ms) 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9360 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [stat] tid 43 osd.4 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 43 2026-02-21T01:28:24.005 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _send_op 43 to 7.1 on osd.4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:43 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28ae9920 con 0x559f28caf770 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 5 client.4390.objecter _op_cancel: cancelling tid 43 r=-125 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter op_cancel tid 43 in session 4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _finish_op 43 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_op_remove 4 43 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9360 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [stat] tid 44 osd.4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 44 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _send_op 44 to 7.1 on osd.4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:44 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd39a0 con 0x559f28caf770 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 5 client.4390.objecter _op_cancel: cancelling tid 44 r=-125 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 10 client.4390.objecter op_cancel tid 44 in session 4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _finish_op 44 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.969+0000 7ff37cbbc880 15 client.4390.objecter _session_op_remove 4 44 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd3780 write_seq 11 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9360 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [stat] tid 45 osd.4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 45 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 15 client.4390.objecter _send_op 45 to 7.1 on osd.4 2026-02-21T01:28:24.006 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:45 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd39a0 con 0x559f28caf770 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 5 client.4390.objecter _op_cancel: cancelling tid 45 r=-125 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter op_cancel tid 45 in session 4 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 librados: complete_aio_write 0x559f28cd3780 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 15 client.4390.objecter _finish_op 45 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 15 client.4390.objecter _session_op_remove 4 45 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 librados: queue_aio_write 0x559f28a3d390 completion 0x559f28cd3780 write_seq 12 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter _op_submit op 0x559f28ae9360 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter _calc_target epoch 22 base noexist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter _get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter _op_submit oid noexist '@7' '@7' [stat] tid 46 osd.4 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter get_session s=0x559f28ba6810 osd=4 3 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 15 client.4390.objecter _session_op_assign 4 46 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 15 client.4390.objecter _send_op 46 to 7.1 on osd.4 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 --> v1:10.20.193.46:6802/3807500891 -- osd_op(unknown.0.0:46 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x559f28cd39a0 con 0x559f28caf770 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 5 client.4390.objecter 1 in flight 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 48 ==== osd_op_reply(43 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2068821074 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(43 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 43 ondisk ... stray 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 49 ==== osd_op_reply(44 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2068821074 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(44 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 44 ondisk ... stray 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 50 ==== osd_op_reply(45 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1936301528 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (0 ms) 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(45 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 45 ondisk ... stray 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 1 -- 10.20.193.46:0/177095123 <== osd.4 v1:10.20.193.46:6802/3807500891 51 ==== osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1936301528 0 0) 0x7ff364003920 con 0x559f28caf770 2026-02-21T01:28:24.007 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter ms_dispatch2 0x559f28a59590 osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter in handle_osd_op_reply 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 7 client.4390.objecter handle_osd_op_reply 46 ondisk uv 0 in 7.1 attempt 0 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 10 client.4390.objecter op 0 rval 0 len 0 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 15 client.4390.objecter handle_osd_op_reply completed tid 46 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 15 client.4390.objecter _finish_op 46 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 4 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 15 client.4390.objecter _session_op_remove 4 46 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 5 client.4390.objecter 0 in flight 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff379e71640 20 librados: complete_aio_write 0x559f28cd3780 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 librados: watch_flush enter 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 librados: watch_flush exit 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter close_session for osd.4 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 >> v1:10.20.193.46:6802/3807500891 conn(0x559f28caf770 legacy=0x559f28ccfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter put_session s=0x559f28ba6810 osd=4 1 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 client.4390.objecter shutdown clearing up homeless session... 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 client.4390.objecter successfully canceled tick 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 >> v1:10.20.193.46:6812/860801619 conn(0x7ff35803d150 legacy=0x7ff35805d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 10 monclient: shutdown 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 >> v1:10.20.193.46:6789/0 conn(0x559f28ba8970 legacy=0x559f28cacb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37ae73640 1 -- 10.20.193.46:0/177095123 reap_dead start 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 shutdown_connections 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 >> 10.20.193.46:0/177095123 conn(0x559f28b07770 msgr2=0x559f28baac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 shutdown_connections 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 -- 10.20.193.46:0/177095123 wait complete. 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:23.970+0000 7ff37cbbc880 1 librados: shutdown 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [----------] 29 tests from AsioRados (18 ms total) 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [----------] Global test environment tear-down 2026-02-21T01:28:24.008 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (1811 ms total) 2026-02-21T01:28:24.009 INFO:tasks.workunit.client.0.trial046.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-21T01:28:24.009 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:28:24.009 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45157 2026-02-21T01:28:24.009 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45157 2026-02-21T01:28:24.093 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-21T01:28:24.093 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] Global test environment set-up. 2026-02-21T01:28:24.093 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-21T01:28:24.093 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosList.ListObjects (121 ms) 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (13 ms) 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset foo1,foo2,foo3 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo1 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo2 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo3 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset foo1,foo4,foo5 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo4 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo5 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo1 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset foo6,foo7 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo7 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo6 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns1:foo4 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns1:foo5 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns2:foo7 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns2:foo6 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns1:foo1 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: :foo1 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: :foo2 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: :foo3 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (35 ms) 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 1 0 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 10 0 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 13 0 2026-02-21T01:28:24.094 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 7 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 14 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 0 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 15 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 11 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 5 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 8 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 6 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 3 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 4 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 12 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 9 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 2 0 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (33 ms) 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: x cursor=MIN 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=1 cursor=9:02547ec2:::1:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=10 cursor=9:52ea6a34:::10:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=13 cursor=9:566253c9:::13:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=7 cursor=9:5c6b0b28:::7:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=14 cursor=9:62a1935d:::14:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=0 cursor=9:6cac518f:::0:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=15 cursor=9:863748b0:::15:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=11 cursor=9:89d3ae78:::11:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=5 cursor=9:b29083e3:::5:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=8 cursor=9:bd63b0f1:::8:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=6 cursor=9:c4fdafeb:::6:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=3 cursor=9:cfc208b3:::3:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=4 cursor=9:d83876eb:::4:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=12 cursor=9:de5d7c5f:::12:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=9 cursor=9:e960b815:::9:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > oid=2 cursor=9:f905c69b:::2:head 2026-02-21T01:28:24.095 INFO:tasks.workunit.client.0.trial046.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=1 cursor=9:02547ec2:::1:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:02547ec2:::1:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:02547ec2:::1:head -> 1 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=10 cursor=9:52ea6a34:::10:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:52ea6a34:::10:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:52ea6a34:::10:head -> 10 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=13 cursor=9:566253c9:::13:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:566253c9:::13:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:566253c9:::13:head -> 13 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=7 cursor=9:5c6b0b28:::7:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:5c6b0b28:::7:head 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:5c6b0b28:::7:head -> 7 2026-02-21T01:28:24.096 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=14 cursor=9:62a1935d:::14:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:62a1935d:::14:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:62a1935d:::14:head -> 14 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=0 cursor=9:6cac518f:::0:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:6cac518f:::0:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:6cac518f:::0:head -> 0 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=15 cursor=9:863748b0:::15:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:863748b0:::15:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:863748b0:::15:head -> 15 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=11 cursor=9:89d3ae78:::11:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:89d3ae78:::11:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:89d3ae78:::11:head -> 11 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=5 cursor=9:b29083e3:::5:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:b29083e3:::5:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:b29083e3:::5:head -> 5 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=8 cursor=9:bd63b0f1:::8:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:bd63b0f1:::8:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:bd63b0f1:::8:head -> 8 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=6 cursor=9:c4fdafeb:::6:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:c4fdafeb:::6:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:c4fdafeb:::6:head -> 6 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=3 cursor=9:cfc208b3:::3:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:cfc208b3:::3:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:cfc208b3:::3:head -> 3 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=4 cursor=9:d83876eb:::4:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:d83876eb:::4:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:d83876eb:::4:head -> 4 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=12 cursor=9:de5d7c5f:::12:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:de5d7c5f:::12:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:de5d7c5f:::12:head -> 12 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=9 cursor=9:e960b815:::9:head 2026-02-21T01:28:24.120 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:e960b815:::9:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:e960b815:::9:head -> 9 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : oid=2 cursor=9:f905c69b:::2:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:f905c69b:::2:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:f905c69b:::2:head -> 2 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:e960b815:::9:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:e960b815:::9:head expected=9:e960b815:::9:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:e960b815:::9:head -> 9 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=9 expected=9 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:de5d7c5f:::12:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:de5d7c5f:::12:head expected=9:de5d7c5f:::12:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:de5d7c5f:::12:head -> 12 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=12 expected=12 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:d83876eb:::4:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:d83876eb:::4:head expected=9:d83876eb:::4:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:d83876eb:::4:head -> 4 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=4 expected=4 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:cfc208b3:::3:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:cfc208b3:::3:head expected=9:cfc208b3:::3:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:cfc208b3:::3:head -> 3 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=3 expected=3 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:52ea6a34:::10:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:52ea6a34:::10:head expected=9:52ea6a34:::10:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:52ea6a34:::10:head -> 10 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=10 expected=10 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:f905c69b:::2:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:f905c69b:::2:head expected=9:f905c69b:::2:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:f905c69b:::2:head -> 2 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=2 expected=2 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:c4fdafeb:::6:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:c4fdafeb:::6:head expected=9:c4fdafeb:::6:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:c4fdafeb:::6:head -> 6 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=6 expected=6 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:b29083e3:::5:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:b29083e3:::5:head expected=9:b29083e3:::5:head 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:b29083e3:::5:head -> 5 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=5 expected=5 2026-02-21T01:28:24.121 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:89d3ae78:::11:head 2026-02-21T01:28:24.212 INFO:tasks.workunit.client.0.trial046.stdout: api_list: list_parallel: process_1_[45889]: starting. 2026-02-21T01:28:24.212 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_1_[45889]: creating pool ceph_test_rados_list_parallel.trial046-45781 2026-02-21T01:28:24.212 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_1_[45889]: created object 0... 2026-02-21T01:28:24.212 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_1_[45889]: created object 25... 2026-02-21T01:28:24.212 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_1_[45889]: created object 49... 2026-02-21T01:28:24.212 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_1_[45889]: finishing. 2026-02-21T01:28:24.212 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_1_[45889]: shutting down. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_2_[45892]: starting. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_2_[45892]: listing objects. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_2_[45892]: listed object 0... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_2_[45892]: listed object 25... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_2_[45892]: saw 50 objects 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_2_[45892]: shutting down. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_3_[46594]: starting. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_3_[46594]: creating pool ceph_test_rados_list_parallel.trial046-45781 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_3_[46594]: created object 0... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_3_[46594]: created object 25... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_3_[46594]: created object 49... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_3_[46594]: finishing. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_3_[46594]: shutting down. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_4_[46595]: starting. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_4_[46595]: listing objects. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_4_[46595]: listed object 0... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_4_[46595]: listed object 25... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_4_[46595]: saw 44 objects 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_4_[46595]: shutting down. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_5_[46596]: starting. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_5_[46596]: removed 25 objects... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_5_[46596]: removed half of the objects 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_5_[46596]: removed 50 objects... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_5_[46596]: removed 50 objects 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_5_[46596]: shutting down. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_6_[46645]: starting. 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_6_[46645]: creating pool ceph_test_rados_list_parallel.trial046-45781 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_6_[46645]: created object 0... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_6_[46645]: created object 25... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_6_[46645]: created object 49... 2026-02-21T01:28:24.213 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_6_[46645]: finishing. 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_6_[46645]: shutting down. 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_7_[46646]: starting. 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_7_[46646]: listing objects. 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_7_[46646]: listed object 0... 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_7_[46646]: listed object 25... 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_7_[46646]: listed object 50... 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_7_[46646]: saw 54 objects 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_7_[46646]: shutting down. 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_8_[46647]: starting. 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_8_[46647]: added 25 objects... 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_8_[46647]: added half of the objects 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_8_[46647]: added 50 objects... 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_8_[46647]: added 50 objects 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_8_[46647]: shutting down. 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.214 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.319 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.319 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_9_[46696]: starting. 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_9_[46696]: creating pool ceph_test_rados_list_parallel.trial046-45781 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_9_[46696]: created object 0... 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_9_[46696]: created object 25... 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_9_[46696]: created object 49... 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_9_[46696]: finishing. 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_9_[46696]: shutting down. 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: starting. 2026-02-21T01:28:24.320 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: listing objects. 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: listed object 0... 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: listed object 25... 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: listed object 50... 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: listed object 75... 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: saw 96 objects 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_10_[46697]: shutting down. 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_13_[46700]: starting. 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_13_[46700]: removed 25 objects... 2026-02-21T01:28:24.321 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_13_[46700]: removed half of the objects 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_13_[46700]: removed 50 objects... 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_13_[46700]: removed 50 objects 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_13_[46700]: shutting down. 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_12_[46699]: starting. 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_12_[46699]: added 25 objects... 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_12_[46699]: added half of the objects 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_12_[46699]: added 50 objects... 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_12_[46699]: added 50 objects 2026-02-21T01:28:24.322 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_12_[46699]: shutting down. 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_11_[46698]: starting. 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_11_[46698]: added 25 objects... 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_11_[46698]: added half of the objects 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_11_[46698]: added 50 objects... 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_11_[46698]: added 50 objects 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_11_[46698]: shutting down. 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.323 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_14_[46781]: starting. 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_14_[46781]: creating pool ceph_test_rados_list_parallel.trial046-45781 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_14_[46781]: created object 0... 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_14_[46781]: created object 25... 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_14_[46781]: created object 49... 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_14_[46781]: finishing. 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_14_[46781]: shutting down. 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.324 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.325 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: starting. 2026-02-21T01:28:24.325 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: listing objects. 2026-02-21T01:28:24.325 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: listed object 0... 2026-02-21T01:28:24.325 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: listed object 25... 2026-02-21T01:28:24.855 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: Running main() from gmock_main.cc 2026-02-21T01:28:24.855 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-21T01:28:24.856 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [----------] Global test environment set-up. 2026-02-21T01:28:24.856 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-21T01:28:24.856 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-21T01:28:24.856 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (2625 ms) 2026-02-21T01:28:24.856 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [----------] 1 test from neocls_handler_error (2625 ms total) 2026-02-21T01:28:24.856 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: 2026-02-21T01:28:24.856 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [----------] Global test environment tear-down 2026-02-21T01:28:24.857 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [==========] 1 test from 1 test suite ran. (2625 ms total) 2026-02-21T01:28:24.857 INFO:tasks.workunit.client.0.trial046.stdout: handler_error: [ PASSED ] 1 test. 2026-02-21T01:28:24.858 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: Running main() from gmock_main.cc 2026-02-21T01:28:24.858 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-21T01:28:24.858 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-21T01:28:24.858 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-21T01:28:24.859 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-21T01:28:24.859 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-21T01:28:24.859 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-21T01:28:24.859 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (77 ms) 2026-02-21T01:28:24.859 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-21T01:28:24.859 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (19 ms) 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (11 ms) 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (12 ms) 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (2 ms) 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-21T01:28:24.860 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (2 ms) 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (1 ms) 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (1 ms) 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (1 ms) 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (1 ms) 2026-02-21T01:28:24.861 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (2 ms) 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (2 ms) 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (5 ms) 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (4 ms) 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (4 ms) 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-21T01:28:24.862 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (1 ms) 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (154 ms total) 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (2647 ms total) 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: cls: Running main() from gmock_main.cc 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: cls: [----------] Global test environment set-up. 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-21T01:28:24.863 INFO:tasks.workunit.client.0.trial046.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: cls: [ OK ] NeoRadosCls.DNE (2635 ms) 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: cls: [----------] 1 test from NeoRadosCls (2635 ms total) 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: cls: 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: cls: [----------] Global test environment tear-down 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: cls: [==========] 1 test from 1 test suite ran. (2635 ms total) 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: cls: [ PASSED ] 1 test. 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-21T01:28:24.864 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (33 ms) 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (17 ms) 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (2609 ms) 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (2660 ms total) 2026-02-21T01:28:24.865 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: 2026-02-21T01:28:24.866 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-21T01:28:24.866 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (2660 ms total) 2026-02-21T01:28:24.866 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-21T01:28:24.871 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: listed object 50... 2026-02-21T01:28:24.871 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: listed object 75... 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: listed object 100... 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: listed object 125... 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: saw 150 objects 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_15_[46782]: shutting down. 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_16_[46783]: starting. 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_16_[46783]: added 25 objects... 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_16_[46783]: added half of the objects 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_16_[46783]: added 50 objects... 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_16_[46783]: added 50 objects 2026-02-21T01:28:24.872 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: process_16_[46783]: shutting down. 2026-02-21T01:28:24.873 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.873 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.873 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.873 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.873 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******************************* 2026-02-21T01:28:24.873 INFO:tasks.workunit.client.0.trial046.stdout: list_parallel: ******* SUCCESS ********** 2026-02-21T01:28:24.882 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-21T01:28:24.882 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-21T01:28:24.882 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-21T01:28:24.882 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-21T01:28:24.882 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-21T01:28:24.882 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (34 ms) 2026-02-21T01:28:24.882 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (15 ms) 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (2610 ms) 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.843976+0000 mon.a [INF] from='client.4597 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45565-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844003+0000 mon.a [INF] from='client.4600 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45617-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844027+0000 mon.a [INF] from='client.4363 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_trial046-45042-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844048+0000 mon.a [INF] from='client.4372 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_trial046-45066-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844067+0000 mon.a [INF] from='client.4378 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_trial046-45082-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844088+0000 mon.a [INF] from='client.4384 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_trial046-45105-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844105+0000 mon.a [INF] from='client.4399 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_trial046-45167-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844122+0000 mon.a [INF] from='client.4408 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_trial046-45197-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.883 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844144+0000 mon.a [INF] from='client.4405 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_trial046-45146-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.884 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844162+0000 mon.a [INF] from='client.4420 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45306-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.884 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844179+0000 mon.a [INF] from='client.4429 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_trial046-45338-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:24.884 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844199+0000 mon.a [INF] from='client.4435 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial046-45269-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:25.856 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844218+0000 mon.a [INF] from='client.4438 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_trial046-45360-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:25.857 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844240+0000 mon.a [INF] from='client.4444 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_trial046-45389-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:25.857 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844260+0000 mon.a [INF] from='client.4450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_trial046-45440-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:25.857 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844276+0000 mon.a [INF] from='client.4459 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_trial046-45482-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:25.857 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844293+0000 mon.a [INF] from='client.4489 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45697-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:25.857 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:23.844309+0000 mon.a [INF] from='client.4492 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_trial046-45742-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:25.857 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.164014+0000 mon.a [INF] from='client.4405 ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial046-45146-1","var":"pg_num","val":"11"} : dispatch 2026-02-21T01:28:25.857 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.164939+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/639202185' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial046-45146-1","var":"pg_num","val":"11"} : dispatch 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.846613+0000 mon.a [INF] from='client.4462 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_trial046-45501-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_trial046-45501-1"}]': finished 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.846650+0000 mon.a [INF] from='client.4576 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritetrial046-46076-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritetrial046-46076-1"}]': finished 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.846671+0000 mon.a [INF] from='client.4594 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectstrial046-46228-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectstrial046-46228-1"}]': finished 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.846693+0000 mon.a [INF] from='client.4405 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_trial046-45146-1","var":"pg_num","val":"11"}]': finished 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.847469+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.0"} : dispatch 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.850816+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.1"} : dispatch 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.853613+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.2"} : dispatch 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.858307+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.3"} : dispatch 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.864064+0000 mon.a [INF] from='client.4405 ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial046-45146-1","var":"pgp_num","val":"11"} : dispatch 2026-02-21T01:28:25.858 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.864885+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/639202185' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial046-45146-1","var":"pgp_num","val":"11"} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.875986+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.4"} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.876941+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.5"} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.877423+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.6"} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.877964+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.7"} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.879193+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.8"} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.879863+0000 client.admin [INF] onexx 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.879977+0000 mon.a [INF] from='client.4801 ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.880812+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3766701174' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-21T01:28:25.859 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.881084+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1553041292' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "13.9"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.887040+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3404972881' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial046-45440-7"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.887286+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1945043550' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial046-45082-16"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.888720+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/391153926' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_trial046-45105-24"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.888926+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3175574931' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial046-45389-7"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.889694+0000 mon.b [INF] from='client.4837 v1:10.20.193.46:0/1945043550' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial046-45082-16"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.914813+0000 mon.a [INF] from='client.4834 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial046-45440-7"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.914953+0000 mon.a [INF] from='client.4837 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial046-45082-16"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.916500+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3404972881' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial046-45440-7"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.920176+0000 mon.a [INF] from='client.4849 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_trial046-45105-24"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.920284+0000 mon.a [INF] from='client.4852 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial046-45389-7"} : dispatch 2026-02-21T01:28:25.860 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.920371+0000 mon.a [INF] from='client.4837 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial046-45082-16"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.921894+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/391153926' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_trial046-45105-24"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.921978+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3175574931' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial046-45389-7"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.922059+0000 mon.b [INF] from='client.4837 v1:10.20.193.46:0/1945043550' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial046-45082-16"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.931269+0000 mon.a [INF] from='client.4834 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial046-45440-7"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.931357+0000 mon.a [INF] from='client.4849 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_trial046-45105-24"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.931434+0000 mon.a [INF] from='client.4852 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial046-45389-7"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.931509+0000 mon.a [INF] from='client.4837 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial046-45082-16"} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.931783+0000 mon.a [INF] from='client.4849 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_trial046-45105-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.932018+0000 mon.a [INF] from='client.4834 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial046-45440-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.932106+0000 mon.a [INF] from='client.4852 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial046-45389-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:25.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.932195+0000 mon.a [INF] from='client.4837 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial046-45082-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:25.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.932750+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/391153926' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_trial046-45105-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:25.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.932834+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3404972881' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial046-45440-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:25.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.932898+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3175574931' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial046-45389-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_1_[45918]: starting. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_1_[45918]: creating pool ceph_test_rados_open_pools_parallel.trial046-45837 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_1_[45918]: created object 0... 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_1_[45918]: created object 25... 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_1_[45918]: created object 49... 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_1_[45918]: finishing. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_1_[45918]: shutting down. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_2_[45921]: starting. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_2_[45921]: rados_pool_create. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_2_[45921]: rados_ioctx_create. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_2_[45921]: shutting down. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: ******************************* 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_3_[46849]: starting. 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_3_[46849]: creating pool ceph_test_rados_open_pools_parallel.trial046-45837 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_3_[46849]: created object 0... 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_3_[46849]: created object 25... 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_3_[46849]: created object 49... 2026-02-21T01:28:27.874 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_3_[46849]: finishing. 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_3_[46849]: shutting down. 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: ******************************* 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_4_[46850]: starting. 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_4_[46850]: rados_pool_create. 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_4_[46850]: rados_ioctx_create. 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: process_4_[46850]: shutting down. 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: ******************************* 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: ******************************* 2026-02-21T01:28:27.875 INFO:tasks.workunit.client.0.trial046.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-21T01:28:27.890 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_1_[45998]: starting. 2026-02-21T01:28:27.890 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_1_[45998]: creating pool ceph_test_rados_delete_pools_parallel.trial046-45864 2026-02-21T01:28:27.890 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_1_[45998]: created object 0... 2026-02-21T01:28:27.890 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_1_[45998]: created object 25... 2026-02-21T01:28:27.890 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_1_[45998]: created object 49... 2026-02-21T01:28:27.890 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_1_[45998]: finishing. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_1_[45998]: shutting down. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_2_[46002]: starting. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_2_[46002]: deleting pool ceph_test_rados_delete_pools_parallel.trial046-45864 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_2_[46002]: shutting down. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: ******************************* 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_3_[46848]: starting. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_3_[46848]: creating pool ceph_test_rados_delete_pools_parallel.trial046-45864 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_3_[46848]: created object 0... 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_3_[46848]: created object 25... 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_3_[46848]: created object 49... 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_3_[46848]: finishing. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_3_[46848]: shutting down. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: ******************************* 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_5_[46852]: starting. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_5_[46852]: listing objects. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_5_[46852]: listed object 0... 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_5_[46852]: listed object 25... 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_5_[46852]: saw 50 objects 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_5_[46852]: shutting down. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: ******************************* 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_4_[46851]: starting. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_4_[46851]: deleting pool ceph_test_rados_delete_pools_parallel.trial046-45864 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: process_4_[46851]: shutting down. 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: ******************************* 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: ******************************* 2026-02-21T01:28:27.891 INFO:tasks.workunit.client.0.trial046.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-21T01:28:28.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:24.932956+0000 mon.b [INF] from='client.4837 v1:10.20.193.46:0/1945043550' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial046-45082-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:28.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863033+0000 mon.a [INF] from='client.4834 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial046-45440-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial046-45440-7"}]': finished 2026-02-21T01:28:28.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863068+0000 mon.a [INF] from='client.4849 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_trial046-45105-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_trial046-45105-24"}]': finished 2026-02-21T01:28:28.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863090+0000 mon.a [INF] from='client.4852 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_trial046-45389-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial046-45389-7"}]': finished 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863111+0000 mon.a [INF] from='client.4837 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_trial046-45082-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial046-45082-16"}]': finished 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863136+0000 mon.a [INF] from='client.4576 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritetrial046-46076-1"}]': finished 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863153+0000 mon.a [INF] from='client.4462 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial046-45501-1"}]': finished 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863169+0000 mon.a [INF] from='client.4594 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial046-46228-1"}]': finished 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863189+0000 mon.a [INF] from='client.4891 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial046-45167-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.863210+0000 mon.a [INF] from='client.4900 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial046-45197-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.865319+0000 mon.a [INF] from='client.4891 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial046-45167-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial046-45167-10"} : dispatch 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.865594+0000 mon.a [INF] from='client.4900 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial046-45197-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial046-45197-10"} : dispatch 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.865860+0000 mon.a [INF] from='client.4462 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial046-45501-1"} : dispatch 2026-02-21T01:28:28.863 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.865976+0000 mon.a [INF] from='client.4594 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial046-46228-1"} : dispatch 2026-02-21T01:28:28.886 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.866311+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1537212495' entity='client.admin' cmd={ cmd: Running main() from gmock_main.cc 2026-02-21T01:28:28.886 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-21T01:28:28.886 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [----------] Global test environment set-up. 2026-02-21T01:28:28.886 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-21T01:28:28.886 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-21T01:28:28.886 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (1639 ms) 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (1998 ms) 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (3021 ms) 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [----------] 3 tests from NeoRadosCmd (6659 ms total) 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [----------] Global test environment tear-down 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [==========] 3 tests from 1 test suite ran. (6659 ms total) 2026-02-21T01:28:28.887 INFO:tasks.workunit.client.0.trial046.stdout: cmd: [ PASSED ] 3 tests. 2026-02-21T01:28:28.914 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: Running main() from gmock_main.cc 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: seed 45105 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (111 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (4 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (2 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (133 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (0 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (0 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (1 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (0 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (1 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (1 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (1 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (1 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (1 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (1 ms) 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-21T01:28:28.915 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (1 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (4 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (1 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (1 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (1 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (1 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (1 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (277 ms total) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1039 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (6 ms) 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-21T01:28:28.916 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (1 ms) 2026-02-21T01:28:29.860 INFO:tasks.workunit.client.0.trial046.stdout: api_"prefix": "osd pool create", "pool": "LibRadosLockEC_trial046-45167-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial046-45167-10"} : dispatch 2026-02-21T01:28:29.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.866638+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/2272305076' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial046-45197-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial046-45197-10"} : dispatch 2026-02-21T01:28:29.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.866734+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/2110425778' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial046-45501-1"} : dispatch 2026-02-21T01:28:29.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.866794+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1118510908' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial046-46228-1"} : dispatch 2026-02-21T01:28:29.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.867152+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3440073940' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial046-45066-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:29.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.870335+0000 mon.a [INF] from='client.4822 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial046-45066-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:29.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.892012+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/4039728728' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial046-46076-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:29.861 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:27.914325+0000 mon.a [INF] from='client.5074 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial046-46076-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.859860+0000 client.admin [INF] threexx 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.859949+0000 mon.a [INF] from='client.4801 ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.860852+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3766701174' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.866218+0000 mon.a [INF] from='client.4462 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial046-45501-1"}]': finished 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.866244+0000 mon.a [INF] from='client.4594 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectstrial046-46228-1"}]': finished 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.866269+0000 mon.a [INF] from='client.4822 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial046-45066-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.866293+0000 mon.a [INF] from='client.5074 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial046-46076-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-21T01:28:29.862 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.869748+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/4039728728' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial046-46076-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial046-46076-2"} : dispatch 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.870071+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/3440073940' entity='client.admin' cmd={"prefix": "osd pool set-quota", "poo list: Running main() from gmock_main.cc 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [----------] Global test environment set-up. 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [----------] 3 tests from NeoradosList 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [ OK ] NeoradosList.ListObjects (2620 ms) 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [ OK ] NeoradosList.ListObjectsNS (3011 ms) 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3016 ms) 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [----------] 3 tests from NeoradosList (8648 ms total) 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [----------] Global test environment tear-down 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [==========] 3 tests from 1 test suite ran. (8648 ms total) 2026-02-21T01:28:30.895 INFO:tasks.workunit.client.0.trial046.stdout: list: [ PASSED ] 3 tests. 2026-02-21T01:28:31.882 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: Running main() from gmock_main.cc 2026-02-21T01:28:31.882 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-21T01:28:31.882 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-21T01:28:31.882 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-21T01:28:31.882 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: seed 45440 2026-02-21T01:28:31.882 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-21T01:28:31.882 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (114 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (1 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (0 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (3 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (120 ms total) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1038 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (1 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (3 ms) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1043 ms total) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (9699 ms total) 2026-02-21T01:28:31.883 INFO:tasks.workunit.client.0.trial046.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: Running main() from gmock_main.cc 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [----------] Global test environment set-up. 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStat.Stat (97 ms) 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (12 ms) 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStat.StatNS (5 ms) 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (1 ms) 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [----------] 5 tests from LibRadosStat (117 ms total) 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1041 ms) 2026-02-21T01:28:31.884 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (3 ms) 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (1 ms) 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1046 ms total) 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [----------] Global test environment tear-down 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (9703 ms total) 2026-02-21T01:28:31.885 INFO:tasks.workunit.client.0.trial046.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: Running main() from gmock_main.cc 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [----------] Global test environment set-up. 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (87 ms) 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-21T01:28:31.888 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: no timeout :/ 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: no timeout :/ 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: no timeout :/ 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: no timeout :/ 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: no timeout :/ 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (33 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (2 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.Checksum (2 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (1 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (1 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (2 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (0 ms) 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-21T01:28:31.889 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.TruncTest (1 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (1 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (2 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.RmXattr (4 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIo.XattrIter (1 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [----------] 14 tests from LibRadosIo (143 ms total) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1035 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (3 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (4 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (1 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (3 ms) 2026-02-21T01:28:31.890 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (2 ms) 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (1 ms) 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (1 ms) 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (4 ms) 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (2 ms) 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1061 ms total) 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [----------] Global test environment tear-down 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [==========] 24 tests from 2 test suites ran. (9741 ms total) 2026-02-21T01:28:31.891 INFO:tasks.workunit.client.0.trial046.stdout: api_io: [ PASSED ] 24 tests. 2026-02-21T01:28:32.866 INFO:tasks.workunit.client.0.trial046.stdout:l": "PoolQuotaPP_trial046-45066-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.881476+0000 mon.a [INF] from='client.5074 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial046-46076-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial046-46076-2"} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.881777+0000 mon.a [INF] from='client.4822 ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial046-45066-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.881896+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/2820143447' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial046-45042-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.882036+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/4030515756' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial046-46228-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.882040+0000 mon.a [INF] from='client.5077 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial046-45042-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.882163+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/2965600505' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45697-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.882165+0000 mon.a [INF] from='client.5092 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial046-46228-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-21T01:28:32.867 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.882285+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/1314370241' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45306-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.882316+0000 mon.a [INF] from='client.5086 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45697-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.882507+0000 mon.a [INF] from='client.5080 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial046-45306-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.933337+0000 mon.a [INF] from='client.4849 ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_trial046-45105-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: got: 2026-02-21T01:28:28.934352+0000 mon.b [INF] from='client.? v1:10.20.193.46:0/391153926' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_trial046-45105-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8012 ms) 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (10672 ms total) 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (10672 ms total) 2026-02-21T01:28:32.868 INFO:tasks.workunit.client.0.trial046.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-21T01:28:33.887 INFO:tasks.workunit.client.0.trial046.stdout: pool: Running main() from gmock_main.cc 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [----------] Global test environment set-up. 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ OK ] NeoRadosPools.PoolList (1613 ms) 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (1998 ms) 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-21T01:28:33.888 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2008 ms) 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2007 ms) 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2001 ms) 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2002 ms) 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [----------] 6 tests from NeoRadosPools (11631 ms total) 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [----------] Global test environment tear-down 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [==========] 6 tests from 1 test suite ran. (11631 ms total) 2026-02-21T01:28:33.889 INFO:tasks.workunit.client.0.trial046.stdout: pool: [ PASSED ] 6 tests. 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: Running main() from gmock_main.cc 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [----------] Global test environment set-up. 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (5632 ms) 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (6517 ms) 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (12149 ms total) 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [----------] Global test environment tear-down 2026-02-21T01:28:34.387 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (12149 ms total) 2026-02-21T01:28:34.388 INFO:tasks.workunit.client.0.trial046.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-21T01:28:35.396 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: Running main() from gmock_main.cc 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [----------] Global test environment set-up. 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (114 ms) 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.LockShared (2 ms) 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-21T01:28:35.397 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1033 ms) 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1002 ms) 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (1 ms) 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.Unlock (1 ms) 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (1 ms) 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (1 ms) 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [----------] 8 tests from LibRadosLock (2158 ms total) 2026-02-21T01:28:35.398 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1034 ms) 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (2 ms) 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1005 ms) 2026-02-21T01:28:35.399 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-21T01:28:35.400 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1002 ms) 2026-02-21T01:28:35.400 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-21T01:28:35.400 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (2 ms) 2026-02-21T01:28:35.400 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-21T01:28:35.400 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (2 ms) 2026-02-21T01:28:35.400 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-21T01:28:35.401 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (2 ms) 2026-02-21T01:28:35.401 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-21T01:28:35.401 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (1 ms) 2026-02-21T01:28:35.401 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3053 ms total) 2026-02-21T01:28:35.401 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: 2026-02-21T01:28:35.401 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [----------] Global test environment tear-down 2026-02-21T01:28:35.401 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (13235 ms total) 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: Running main() from gmock_main.cc 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: seed 45197 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (110 ms) 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (2 ms) 2026-02-21T01:28:35.402 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1022 ms) 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1002 ms) 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (1 ms) 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (1 ms) 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (1 ms) 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-21T01:28:35.403 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (1 ms) 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2144 ms total) 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1035 ms) 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (2 ms) 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1002 ms) 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-21T01:28:35.404 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1002 ms) 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (2 ms) 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (2 ms) 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (2 ms) 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (1 ms) 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3052 ms total) 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-21T01:28:35.405 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (13232 ms total) 2026-02-21T01:28:35.406 INFO:tasks.workunit.client.0.trial046.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: notify 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1024 ms) 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (2 ms) 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1026 ms total) 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: notify 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (34 ms) 2026-02-21T01:28:37.434 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: notify 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3502 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (2 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (1 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 141733920772 notifier_gid 5098 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (2 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 141733920773 notifier_gid 5098 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (2 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 141733920774 notifier_gid 5098 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (2 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 141733920775 notifier_gid 5098 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (3 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 141733920776 notifier_gid 5098 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (2 ms) 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-21T01:28:37.435 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 141733920777 notifier_gid 5098 2026-02-21T01:28:37.436 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (2 ms) 2026-02-21T01:28:37.436 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-21T01:28:37.436 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: trying... 2026-02-21T01:28:37.436 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 141733920778 notifier_gid 5098 2026-02-21T01:28:37.436 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: timed out 2026-02-21T01:28:37.436 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: flushing 2026-02-21T01:28:41.400 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notifyio_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-21T01:28:41.400 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (0 ms) 2026-02-21T01:28:41.400 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (1 ms) 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (2 ms) 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (3 ms) 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (1 ms) 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (2 ms) 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (1 ms) 2026-02-21T01:28:41.401 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (1 ms) 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (1 ms) 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (4 ms) 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (8463 ms) 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1033 ms) 2026-02-21T01:28:41.402 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (2 ms) 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (1 ms) 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (1 ms) 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (10570 ms total) 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (19247 ms total) 2026-02-21T01:28:41.403 INFO:tasks.workunit.client.0.trial046.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-21T01:28:42.396 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-21T01:28:42.397 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-21T01:28:42.397 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-21T01:28:42.397 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-21T01:28:42.397 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-21T01:28:42.397 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify_test_cb 2026-02-21T01:28:42.398 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (103 ms) 2026-02-21T01:28:42.398 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-21T01:28:42.398 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-21T01:28:42.398 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94788725260000 err -107 2026-02-21T01:28:42.398 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1003 ms) 2026-02-21T01:28:42.398 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-21T01:28:42.399 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-21T01:28:42.399 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94788725407072 err -107 2026-02-21T01:28:42.399 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1003 ms) 2026-02-21T01:28:42.399 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-21T01:28:42.399 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 103079215105 cookie 94788725407072 2026-02-21T01:28:42.399 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (2 ms) 2026-02-21T01:28:42.399 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-21T01:28:42.400 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 103079215104 cookie 94788725696528 2026-02-21T01:28:42.400 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (2 ms) 2026-02-21T01:28:42.400 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-21T01:28:42.400 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 103079215104 cookie 94788725696528 2026-02-21T01:28:42.400 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (1 ms) 2026-02-21T01:28:42.400 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-21T01:28:42.401 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 103079215110 cookie 94788725697456 2026-02-21T01:28:42.401 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 103079215110 cookie 94788725699808 2026-02-21T01:28:42.401 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (2 ms) 2026-02-21T01:28:42.401 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-21T01:28:42.401 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 103079215105 cookie 94788725697456 2026-02-21T01:28:42.401 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 107374182402 cookie 94788725697456 2026-02-21T01:28:42.401 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3002 ms) 2026-02-21T01:28:42.402 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-21T01:28:42.402 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-21T01:28:42.402 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94788725697456 err -107 2026-02-21T01:28:42.402 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_cb from 4459 notify_id 137438953480 cookie 94788725697456 2026-02-21T01:28:42.402 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5004 ms) 2026-02-21T01:28:42.402 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-21T01:28:42.402 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-21T01:28:42.403 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94788725699728 err -107 2026-02-21T01:28:42.403 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1002 ms) 2026-02-21T01:28:42.403 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11128 ms total) 2026-02-21T01:28:42.403 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: 2026-02-21T01:28:42.403 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-21T01:28:42.403 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-21T01:28:42.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify_test_cb 2026-02-21T01:28:42.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify_test_cb 2026-02-21T01:28:42.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: watch_notify_test_cb 2026-02-21T01:28:42.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1028 ms) 2026-02-21T01:28:42.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1028 ms total) 2026-02-21T01:28:42.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: 2026-02-21T01:28:42.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-21T01:28:42.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (20206 ms total) 2026-02-21T01:28:42.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-21T01:28:42.406 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: Running main() from gmock_main.cc 2026-02-21T01:28:42.406 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-21T01:28:42.406 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [----------] Global test environment set-up. 2026-02-21T01:28:42.406 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-21T01:28:42.407 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-21T01:28:42.407 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (6627 ms) 2026-02-21T01:28:42.407 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-21T01:28:42.407 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (6521 ms) 2026-02-21T01:28:42.407 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-21T01:28:42.407 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (7000 ms) 2026-02-21T01:28:42.407 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [----------] 3 tests from NeoradosECList (20150 ms total) 2026-02-21T01:28:42.408 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: 2026-02-21T01:28:42.408 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [----------] Global test environment tear-down 2026-02-21T01:28:42.408 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (20150 ms total) 2026-02-21T01:28:42.408 INFO:tasks.workunit.client.0.trial046.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-21T01:28:43.409 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-21T01:28:43.410 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (2658 ms) 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3014 ms) 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3008 ms) 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (2998 ms) 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (2525 ms) 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (2983 ms) 2026-02-21T01:28:43.411 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-21T01:28:43.412 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (4014 ms) 2026-02-21T01:28:43.412 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (21204 ms total) 2026-02-21T01:28:43.412 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: 2026-02-21T01:28:43.412 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-21T01:28:43.412 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (21204 ms total) 2026-02-21T01:28:43.412 INFO:tasks.workunit.client.0.trial046.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: handle_notify cookie 94420006373856 notify_id 94489280512 notifier_gid 4627 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (2613 ms) 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: Trying... 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: handle_notify cookie 94420019247120 notify_id 107374182400 notifier_gid 4825 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: Waiting for 3.000000000s 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: Timed out. 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: Flushing... 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: Flushed... 2026-02-21T01:28:44.391 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7012 ms) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (9625 ms total) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (2507 ms) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (4013 ms) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (2991 ms) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (2994 ms) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (12508 ms total) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (22133 ms total) 2026-02-21T01:28:44.392 INFO:tasks.workunit.client.0.trial046.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: Running main() from gmock_main.cc 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [----------] Global test environment set-up. 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (2603 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3011 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3012 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3004 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (2515 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (2986 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (3012 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (1985 ms) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (22131 ms total) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [----------] Global test environment tear-down 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (22131 ms total) 2026-02-21T01:28:44.394 INFO:tasks.workunit.client.0.trial046.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-21T01:28:47.419 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-21T01:28:47.419 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] Global test environment set-up. 2026-02-21T01:28:47.419 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-21T01:28:47.419 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: 2026-02-21T01:28:22.195+0000 7fbe25213880 -1 failed for service _ceph-mon._tcp 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: 2026-02-21T01:28:22.195+0000 7fbe25213880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (27 ms) 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-21T01:28:47.420 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5004 ms) 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5032 ms total) 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: started 0x558286a5cde0 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: started 0x55828675afb0 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: started 2 aios 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: waiting 0x558286a5cde0 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: waiting 0x55828675afb0 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: done. 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (5678 ms) 2026-02-21T01:28:47.421 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (5678 ms total) 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.Exec (15 ms) 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (2 ms) 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (1 ms) 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-21T01:28:47.422 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4974 ms) 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (7431 ms) 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] 8 tests from LibRadosMisc (12425 ms total) 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [----------] Global test environment tear-down 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (25230 ms total) 2026-02-21T01:28:47.423 INFO:tasks.workunit.client.0.trial046.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-21T01:28:49.320 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2026-02-21T01:28:49.320 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [----------] Global test environment set-up. 2026-02-21T01:28:49.320 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-21T01:28:49.320 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-21T01:28:49.320 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5016 ms) 2026-02-21T01:28:49.321 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-21T01:28:49.321 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ OK ] LibRadosService.RegisterLate (10 ms) 2026-02-21T01:28:49.321 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-21T01:28:49.321 INFO:tasks.workunit.client.0.trial046.stdout: api_service: cluster: 2026-02-21T01:28:49.321 INFO:tasks.workunit.client.0.trial046.stdout: api_service: id: 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:49.321 INFO:tasks.workunit.client.0.trial046.stdout: api_service: health: HEALTH_OK 2026-02-21T01:28:49.322 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.322 INFO:tasks.workunit.client.0.trial046.stdout: api_service: services: 2026-02-21T01:28:49.322 INFO:tasks.workunit.client.0.trial046.stdout: api_service: mon: 3 daemons, quorum a,b (age 11s) [leader: a], out of quorum: c 2026-02-21T01:28:49.322 INFO:tasks.workunit.client.0.trial046.stdout: api_service: mgr: x(active, since 40s) 2026-02-21T01:28:49.322 INFO:tasks.workunit.client.0.trial046.stdout: api_service: osd: 6 osds: 6 up (since 38s), 6 in (since 41s) 2026-02-21T01:28:49.322 INFO:tasks.workunit.client.0.trial046.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: data: 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: pools: 24 pools, 665 pgs 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: objects: 4 objects, 577 KiB 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: usage: 160 MiB used, 540 GiB / 540 GiB avail 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: pgs: 55.338% pgs unknown 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 43.308% pgs not active 2026-02-21T01:28:49.323 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 368 unknown 2026-02-21T01:28:49.324 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 288 creating+peering 2026-02-21T01:28:49.324 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 9 active+clean 2026-02-21T01:28:49.324 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.324 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.324 INFO:tasks.workunit.client.0.trial046.stdout: api_service: cluster: 2026-02-21T01:28:49.324 INFO:tasks.workunit.client.0.trial046.stdout: api_service: id: 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:28:49.324 INFO:tasks.workunit.client.0.trial046.stdout: api_service: health: HEALTH_OK 2026-02-21T01:28:49.325 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.325 INFO:tasks.workunit.client.0.trial046.stdout: api_service: services: 2026-02-21T01:28:49.325 INFO:tasks.workunit.client.0.trial046.stdout: api_service: mon: 3 daemons, quorum a,b (age 13s) [leader: a], out of quorum: c 2026-02-21T01:28:49.325 INFO:tasks.workunit.client.0.trial046.stdout: api_service: mgr: x(active, since 42s) 2026-02-21T01:28:49.325 INFO:tasks.workunit.client.0.trial046.stdout: api_service: osd: 6 osds: 6 up (since 40s), 6 in (since 43s) 2026-02-21T01:28:49.325 INFO:tasks.workunit.client.0.trial046.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-21T01:28:49.325 INFO:tasks.workunit.client.0.trial046.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: data: 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: pools: 19 pools, 457 pgs 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: objects: 4 objects, 577 KiB 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: usage: 160 MiB used, 540 GiB / 540 GiB avail 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: pgs: 56.018% pgs unknown 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 42.013% pgs not active 2026-02-21T01:28:49.326 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 256 unknown 2026-02-21T01:28:49.327 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 192 creating+peering 2026-02-21T01:28:49.327 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 9 active+clean 2026-02-21T01:28:49.327 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.327 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.327 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2070 ms) 2026-02-21T01:28:49.328 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-21T01:28:49.328 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ OK ] LibRadosService.Status (20011 ms) 2026-02-21T01:28:49.328 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [----------] 4 tests from LibRadosService (27109 ms total) 2026-02-21T01:28:49.328 INFO:tasks.workunit.client.0.trial046.stdout: api_service: 2026-02-21T01:28:49.328 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [----------] Global test environment tear-down 2026-02-21T01:28:49.328 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27109 ms total) 2026-02-21T01:28:49.329 INFO:tasks.workunit.client.0.trial046.stdout: api_service: [ PASSED ] 4 tests. 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout:_pp: flushed 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3002 ms) 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: trying... 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634560896 notify_id 154618822667 notifier_gid 5098 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: timed out 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: flushing 2026-02-21T01:28:50.404 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: flushed 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3002 ms) 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: List watches 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: notify2 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634556688 notify_id 167503724545 notifier_gid 5098 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: notify2 done 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: watch_check 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: unwatch2 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: flushing 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: done 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3005 ms) 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: List watches 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: notify2 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: handle_notify cookie 94813634556688 notify_id 180388626444 notifier_gid 5098 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: notify2 done 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: watch_check 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: unwatch2 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: flushing 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: done 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3004 ms) 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (15571 ms total) 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (28214 ms total) 2026-02-21T01:28:50.405 INFO:tasks.workunit.client.0.trial046.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-21T01:28:52.265 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-21T01:28:52.265 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5011 ms) 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (15 ms) 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20013 ms) 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: attempt 0 of 20 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5020 ms) 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30060 ms total) 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30060 ms total) 2026-02-21T01:28:52.266 INFO:tasks.workunit.client.0.trial046.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-21T01:28:54.401 INFO:tasks.workunit.client.0.trial046.stdout: misc: Running main() from gmock_main.cc 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [----------] Global test environment set-up. 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.Version (1620 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (1998 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.LongName (3020 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (3002 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (2502 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3025 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.Exec (2977 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3008 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (2995 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.BigObject (2994 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2008 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (2995 ms) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [----------] 12 tests from NeoRadosMisc (32149 ms total) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [----------] Global test environment tear-down 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [==========] 12 tests from 1 test suite ran. (32149 ms total) 2026-02-21T01:28:54.402 INFO:tasks.workunit.client.0.trial046.stdout: misc: [ PASSED ] 12 tests. 2026-02-21T01:28:59.396 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: Running main() from gmock_main.cc 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [----------] Global test environment set-up. 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2692 ms) 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3009 ms) 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-21T01:28:59.397 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3011 ms) 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3003 ms) 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2524 ms) 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (4981 ms) 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5003 ms) 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5002 ms) 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (7995 ms) 2026-02-21T01:28:59.398 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [----------] 9 tests from LibRadosPools (37224 ms total) 2026-02-21T01:28:59.399 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: 2026-02-21T01:28:59.399 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [----------] Global test environment tear-down 2026-02-21T01:28:59.399 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (37224 ms total) 2026-02-21T01:28:59.399 INFO:tasks.workunit.client.0.trial046.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-21T01:29:03.405 INFO:tasks.workunit.client.0.trial046.stdout: io: Running main() from gmock_main.cc 2026-02-21T01:29:03.405 INFO:tasks.workunit.client.0.trial046.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-21T01:29:03.405 INFO:tasks.workunit.client.0.trial046.stdout: io: [----------] Global test environment set-up. 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.Limits (2623 ms) 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3014 ms) 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.ReadOp (3019 ms) 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.SparseRead (2995 ms) 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.RoundTrip (2524 ms) 2026-02-21T01:29:03.406 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (2980 ms) 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3005 ms) 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (2999 ms) 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (3011 ms) 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.Trunc (2994 ms) 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.Remove (2995 ms) 2026-02-21T01:29:03.407 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3008 ms) 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.RmXattr (2991 ms) 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3004 ms) 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [----------] 14 tests from NeoRadosIo (41167 ms total) 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [----------] Global test environment tear-down 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [==========] 14 tests from 1 test suite ran. (41167 ms total) 2026-02-21T01:29:03.408 INFO:tasks.workunit.client.0.trial046.stdout: io: [ PASSED ] 14 tests. 2026-02-21T01:29:06.412 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: Running main() from gmock_main.cc 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [----------] Global test environment set-up. 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (2607 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3015 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3012 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (2998 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (2521 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (2984 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (3006 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (2999 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (3010 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (2994 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (2994 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3008 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2991 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3006 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (2998 ms) 2026-02-21T01:29:06.413 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (44149 ms total) 2026-02-21T01:29:06.414 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: 2026-02-21T01:29:06.414 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [----------] Global test environment tear-down 2026-02-21T01:29:06.414 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (44149 ms total) 2026-02-21T01:29:06.414 INFO:tasks.workunit.client.0.trial046.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-21T01:29:17.405 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: Running main() from gmock_main.cc 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2011 ms) 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2006 ms) 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2009 ms) 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-21T01:29:17.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2000 ms) 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (8028 ms total) 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4043 ms) 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3988 ms) 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5003 ms) 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (13035 ms total) 2026-02-21T01:29:17.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2995 ms) 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2007 ms) 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2003 ms) 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1990 ms) 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8997 ms total) 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-21T01:29:17.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4003 ms) 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4004 ms) 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8007 ms total) 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (55230 ms total) 2026-02-21T01:29:17.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-21T01:29:17.411 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.411 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45687 2026-02-21T01:29:17.411 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45687 2026-02-21T01:29:17.411 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45404 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45404 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45263 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45263 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45098 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45098 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45346 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45346 2026-02-21T01:29:17.412 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45822 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45822 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45855 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45855 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45115 2026-02-21T01:29:17.413 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45115 2026-02-21T01:29:30.399 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-21T01:29:30.399 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-21T01:29:30.399 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-21T01:29:30.399 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-21T01:29:30.399 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-21T01:29:30.399 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: seed 45269 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (116 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (4 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (5 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (3 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (1 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (0 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (1 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (0 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (3 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (0 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (1 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (2 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (639 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (114 ms) 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-21T01:29:30.400 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: done waiting, doing copies 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: done waiting 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60210 ms) 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (2 ms) 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (1 ms) 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4434 ms) 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-21T01:29:30.401 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-21T01:29:32.405 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (655 api_snapshots_pp: Running main() from gmock_main.cc 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: seed 45360 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2011 ms) 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2006 ms) 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2009 ms) 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-21T01:29:32.406 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2000 ms) 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3513 ms) 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (11541 ms total) 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4013 ms) 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3980 ms) 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6003 ms) 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4001 ms) 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-21T01:29:32.407 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2014 ms) 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial046-45360-7 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17981 ms) 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37994 ms total) 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (3 ms) 2026-02-21T01:29:32.408 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5011 ms) 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5015 ms total) 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3002 ms) 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (1997 ms) 2026-02-21T01:29:32.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ snapshots: Running main() from gmock_main.cc 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [----------] Global test environment set-up. 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (4636 ms) 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (4992 ms) 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (3513 ms) 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-21T01:29:36.409 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (5008 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (6998 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (25149 ms total) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (4998 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6006 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7993 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5998 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4002 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial046-46342-11. 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: Waiting for snaps to purge. 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20005 ms) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (49003 ms total) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [----------] Global test environment tear-down 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (74153 ms total) 2026-02-21T01:29:36.410 INFO:tasks.workunit.client.0.trial046.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: Running main() from gmock_main.cc 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [----------] Global test environment set-up. 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2718 ms) 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (3008 ms) 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3021 ms) 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (2997 ms) 2026-02-21T01:29:45.403 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2516 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (2984 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3013 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (2990 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3011 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2994 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2994 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3008 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2994 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3004 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.Flush (2998 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2994 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3003 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3001 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3003 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3010 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (2990 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2996 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2997 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3003 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3003 ms) 2026-02-21T01:29:45.404 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-21T01:29:45.405 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3010 ms) 2026-02-21T01:29:45.405 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-21T01:29:45.405 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (2996 ms) 2026-02-21T01:29:45.405 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-21T01:29:46.188 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-21T01:29:46.188 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-21T01:29:46.189 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-21T01:29:46.201 INFO:tasks.ceph.mon.c:Started 2026-02-21T01:29:46.201 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:29:46.201 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.269+0000 7f4dde1b3640 10 monclient: get_monmap_and_config 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.269+0000 7f4dde1b3640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.269+0000 7f4dde1b3640 10 monclient: monmap: 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:46.270038+0000 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:46.270038+0000 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:46.270 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 1 Processor -- start 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 1 -- start start 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient: init 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient(hunting): picked mon.noname-a con 0x7f4dd8058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient(hunting): picked mon.noname-c con 0x7f4dd8057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient(hunting): picked mon.noname-b con 0x7f4dd8181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd8056c50 con 0x7f4dd8058260 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd808eda0 con 0x7f4dd8057630 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd808f5c0 con 0x7f4dd8181e80 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 10 monclient(hunting): authenticate will time out at 717.975568s 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd77fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f4dd8058260 0x7f4dd808df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:32956/0 (socket says 10.20.193.43:32956) 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd77fe640 1 -- 10.20.193.43:0/3697937329 learned_addr learned my addr 10.20.193.43:0/3697937329 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396762131 0 0) 0x7f4dd8056c50 con 0x7f4dd8058260 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient(hunting): my global_id is 24504 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dbc003610 con 0x7f4dd8058260 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3035066239 0 0) 0x7f4dbc003610 con 0x7f4dd8058260 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 >> v1:10.20.193.43:6790/0 conn(0x7f4dd8181e80 legacy=0x7f4dd81a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 >> v1:10.20.193.46:6789/0 conn(0x7f4dd8057630 legacy=0x7f4dd808e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 monclient: found mon.noname-a 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd80563b0 con 0x7f4dd8058260 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 5 monclient: authenticate success, global_id 24504 2026-02-21T01:29:46.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4dc4002df0 con 0x7f4dd8058260 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dd67fc640 10 monclient: dump: 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.270+0000 7f4dde1b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4dc4003080 con 0x7f4dd8058260 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dd67fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dd67fc640 1 -- 10.20.193.43:0/3697937329 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4dc4003480 con 0x7f4dd8058260 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 4 set_mon_vals no callback set 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dd67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dd67fc640 10 monclient: dump: 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 10 monclient: shutdown 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 1 -- 10.20.193.43:0/3697937329 >> v1:10.20.193.43:6789/0 conn(0x7f4dd8058260 legacy=0x7f4dd808df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 1 -- 10.20.193.43:0/3697937329 shutdown_connections 2026-02-21T01:29:46.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 1 -- 10.20.193.43:0/3697937329 >> 10.20.193.43:0/3697937329 conn(0x7f4dd8090360 msgr2=0x7f4dd8090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 1 -- 10.20.193.43:0/3697937329 shutdown_connections 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.271+0000 7f4dde1b3640 1 -- 10.20.193.43:0/3697937329 wait complete. 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient: monmap: 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:46.275 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 librados: starting msgr at 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 librados: starting objecter 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 Processor -- start 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 -- start start 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 librados: setting wanted keys 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 librados: calling monclient init 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient: init 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient(hunting): picked mon.noname-b con 0x7f4dd8057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient(hunting): picked mon.noname-c con 0x7f4dd8058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient(hunting): picked mon.noname-a con 0x7f4dd8181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd8149a00 con 0x7f4dd8181e80 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd8130c50 con 0x7f4dd8057630 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd812e3a0 con 0x7f4dd8058260 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dde1b3640 10 monclient(hunting): authenticate will time out at 717.977498s 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dd6ffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f4dd8058260 0x7f4dd81706a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34696/0 (socket says 10.20.193.43:34696) 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dd6ffd640 1 -- 10.20.193.43:0/73500438 learned_addr learned my addr 10.20.193.43:0/73500438 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4dd7fff640 1 --1- 10.20.193.43:0/73500438 >> v1:10.20.193.43:6789/0 conn(0x7f4dd8181e80 0x7f4dd8171dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:32972/0 (socket says 10.20.193.43:32972) 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 client.?.objecter ms_handle_connect 0x7f4dd8058260 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 client.?.objecter ms_handle_connect 0x7f4dd8181e80 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 client.?.objecter ms_handle_connect 0x7f4dd8057630 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454768973 0 0) 0x7f4dd8130c50 con 0x7f4dd8057630 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 10 monclient(hunting): my global_id is 28963 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.272+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4da8003610 con 0x7f4dd8057630 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940742355 0 0) 0x7f4dd8149a00 con 0x7f4dd8181e80 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): my global_id is 24507 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dd8130c50 con 0x7f4dd8181e80 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3439863646 0 0) 0x7f4da8003610 con 0x7f4dd8057630 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4dd8149a00 con 0x7f4dd8057630 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4dc4003230 con 0x7f4dd8057630 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): dump: 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3991664482 0 0) 0x7f4dd8130c50 con 0x7f4dd8181e80 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4da8003610 con 0x7f4dd8181e80 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4dcc0032b0 con 0x7f4dd8181e80 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient(hunting): dump: 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 798178277 0 0) 0x7f4dd8149a00 con 0x7f4dd8057630 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 >> v1:10.20.193.43:6790/0 conn(0x7f4dd8058260 legacy=0x7f4dd81706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 >> v1:10.20.193.43:6789/0 conn(0x7f4dd8181e80 legacy=0x7f4dd8171dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 monclient: found mon.b 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd812fde0 con 0x7f4dd8057630 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 5 monclient: authenticate success, global_id 28963 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 monclient: _renew_subs 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd812e8f0 con 0x7f4dd8057630 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 client.28963.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 monclient: _renew_subs 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4dd812f630 con 0x7f4dd8057630 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 1 librados: init done 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4dc4003030 con 0x7f4dd8057630 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4dc4004e80 con 0x7f4dd8057630 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dd5ffb640 4 set_mon_vals no callback set 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4db3fff640 10 monclient: dump: 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.273+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd808a590 con 0x7f4dd8057630 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f4dc4011800 con 0x7f4dd8057630 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(104..104 src has 1..104) ==== 6396+0+0 (unknown 4188620942 0 0) 0x7f4dc404e840 con 0x7f4dd8057630 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4db3fff640 10 client.28963.objecter ms_dispatch2 0x7f4dd8000b90 osd_map(104..104 src has 1..104) 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4db3fff640 3 client.28963.objecter handle_osd_map got epochs [104,104] > 0 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4db3fff640 3 client.28963.objecter handle_osd_map decoding full epoch 104 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4db3fff640 20 client.28963.objecter dump_active .. 0 homeless 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4dd6ffd640 10 monclient: get_auth_request con 0x7f4da803e980 auth_method 0 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.274+0000 7f4db3fff640 10 client.28963.objecter ms_handle_connect 0x7f4da803e980 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.276+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4dd808a590 con 0x7f4dd8057630 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.276+0000 7f4db3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.276+0000 7f4db3fff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:46.429 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.428+0000 7f4dde1b3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:29:46.429 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.428+0000 7f4dde1b3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:46.429 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.428+0000 7f4dde1b3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:29:46.430 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.428+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4dd8054d90 con 0x7f4dd8057630 2026-02-21T01:29:46.430 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.428+0000 7f4db3fff640 1 -- 10.20.193.43:0/73500438 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 1494796035) 0x7f4dc40176e0 con 0x7f4dd8057630 2026-02-21T01:29:46.430 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.428+0000 7f4db3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:46.430 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.428+0000 7f4db3fff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:46.430 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 10 librados: watch_flush enter 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 10 librados: watch_flush exit 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 20 client.28963.objecter shutdown clearing up homeless session... 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 10 client.28963.objecter successfully canceled tick 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 >> v1:10.20.193.46:6812/860801619 conn(0x7f4da803e980 legacy=0x7f4da805ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 10 monclient: shutdown 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 >> v1:10.20.193.46:6789/0 conn(0x7f4dd8057630 legacy=0x7f4dd81492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 shutdown_connections 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 >> 10.20.193.43:0/73500438 conn(0x7f4dd8090360 msgr2=0x7f4dd808aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 shutdown_connections 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 1 -- 10.20.193.43:0/73500438 wait complete. 2026-02-21T01:29:46.431 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.429+0000 7f4dde1b3640 1 librados: shutdown 2026-02-21T01:29:46.438 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:29:46.438 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:29:46.438 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:29:46.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.505+0000 7fa5853c0640 10 monclient: get_monmap_and_config 2026-02-21T01:29:46.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.505+0000 7fa5853c0640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.505+0000 7fa5853c0640 10 monclient: monmap: 2026-02-21T01:29:46.506 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.506 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.506 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:46.505781+0000 2026-02-21T01:29:46.506 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:46.505781+0000 2026-02-21T01:29:46.507 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.507 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.507 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.507 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:46.507 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:46.507 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.505+0000 7fa5853c0640 1 Processor -- start 2026-02-21T01:29:46.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.505+0000 7fa5853c0640 1 -- start start 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.505+0000 7fa5853c0640 10 monclient: init 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 10 monclient(hunting): picked mon.noname-c con 0x7fa58008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 10 monclient(hunting): picked mon.noname-a con 0x7fa58008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 10 monclient(hunting): picked mon.noname-b con 0x7fa58008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa58008a690 con 0x7fa58008d4d0 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa58008b910 con 0x7fa58008ddb0 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa580088ae0 con 0x7fa58008d8d0 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 10 monclient(hunting): authenticate will time out at 718.211218s 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57f7fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fa58008d8d0 0x7fa58019f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34712/0 (socket says 10.20.193.43:34712) 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57f7fe640 1 -- 10.20.193.43:0/19091361 learned_addr learned my addr 10.20.193.43:0/19091361 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369948906 0 0) 0x7fa58008a690 con 0x7fa58008d4d0 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): my global_id is 24510 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa56c003610 con 0x7fa58008d4d0 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155691354 0 0) 0x7fa58008b910 con 0x7fa58008ddb0 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient(hunting): my global_id is 28966 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa58008a690 con 0x7fa58008ddb0 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 169710035 0 0) 0x7fa56c003610 con 0x7fa58008d4d0 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 >> v1:10.20.193.43:6790/0 conn(0x7fa58008d8d0 legacy=0x7fa58019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 >> v1:10.20.193.46:6789/0 conn(0x7fa58008ddb0 legacy=0x7fa58008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 monclient: found mon.noname-a 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5801a3ef0 con 0x7fa58008d4d0 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa568002df0 con 0x7fa58008d4d0 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa57dffb640 10 monclient: dump: 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.521 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 5 monclient: authenticate success, global_id 24510 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.506+0000 7fa5853c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5680030f0 con 0x7fa58008d4d0 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa57dffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa57dffb640 1 -- 10.20.193.43:0/19091361 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa568003530 con 0x7fa58008d4d0 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa57dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa57dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa57dffb640 10 monclient: dump: 2026-02-21T01:29:46.522 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 4 set_mon_vals no callback set 2026-02-21T01:29:46.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 10 monclient: shutdown 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 1 -- 10.20.193.43:0/19091361 >> v1:10.20.193.43:6789/0 conn(0x7fa58008d4d0 legacy=0x7fa58017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 1 -- 10.20.193.43:0/19091361 shutdown_connections 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 1 -- 10.20.193.43:0/19091361 >> 10.20.193.43:0/19091361 conn(0x7fa58008f480 msgr2=0x7fa58008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 1 -- 10.20.193.43:0/19091361 shutdown_connections 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 1 -- 10.20.193.43:0/19091361 wait complete. 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 10 monclient: monmap: 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:46.524 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 1 librados: starting msgr at 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.507+0000 7fa5853c0640 1 librados: starting objecter 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 Processor -- start 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 -- start start 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 librados: setting wanted keys 2026-02-21T01:29:46.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 librados: calling monclient init 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient: init 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient(hunting): picked mon.noname-b con 0x7fa58008d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient(hunting): picked mon.noname-a con 0x7fa58008d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient(hunting): picked mon.noname-c con 0x7fa58008ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5801070a0 con 0x7fa58008d8d0 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa580087430 con 0x7fa58008d4d0 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa580109400 con 0x7fa58008ddb0 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient(hunting): authenticate will time out at 718.213379s 2026-02-21T01:29:46.526 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa57e7fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fa58008d8d0 0x7fa58018d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:32982/0 (socket says 10.20.193.43:32982) 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa57e7fc640 1 -- 10.20.193.43:0/603037134 learned_addr learned my addr 10.20.193.43:0/603037134 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 client.?.objecter ms_handle_connect 0x7fa58008ddb0 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 client.?.objecter ms_handle_connect 0x7fa58008d8d0 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187431160 0 0) 0x7fa5801070a0 con 0x7fa58008d8d0 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): my global_id is 24513 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54c003610 con 0x7fa58008d8d0 2026-02-21T01:29:46.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 client.?.objecter ms_handle_connect 0x7fa58008d4d0 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1047700209 0 0) 0x7fa54c003610 con 0x7fa58008d8d0 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5801070a0 con 0x7fa58008d8d0 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa568002db0 con 0x7fa58008d8d0 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): dump: 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.528 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2423220745 0 0) 0x7fa5801070a0 con 0x7fa58008d8d0 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.43:6790/0 conn(0x7fa58008ddb0 legacy=0x7fa58018f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.46:6789/0 conn(0x7fa58008d4d0 legacy=0x7fa58011da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 monclient: found mon.a 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58011e170 con 0x7fa58008d8d0 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 5 monclient: authenticate success, global_id 24513 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient: _renew_subs 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa58005e190 con 0x7fa58008d8d0 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa568003b00 con 0x7fa58008d8d0 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 client.24513.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa568003ed0 con 0x7fa58008d8d0 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient: _renew_subs 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa580105da0 con 0x7fa58008d8d0 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa57d7fa640 4 set_mon_vals no callback set 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa5853c0640 1 librados: init done 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.508+0000 7fa55f7fe640 10 monclient: dump: 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa5853c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa58008edd0 con 0x7fa5801a10d0 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 client.24513.objecter ms_handle_connect 0x7fa5801a10d0 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 client.24513.objecter resend_mon_ops 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035899315 0 0) 0x7fa58008edd0 con 0x7fa5801a10d0 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient(hunting): my global_id is 24516 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5801070a0 con 0x7fa5801a10d0 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1412940228 0 0) 0x7fa5801070a0 con 0x7fa5801a10d0 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa58008edd0 con 0x7fa5801a10d0 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa574002f10 con 0x7fa5801a10d0 2026-02-21T01:29:46.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient: dump: 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.534 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2905163623 0 0) 0x7fa58008edd0 con 0x7fa5801a10d0 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5800008d0 con 0x7fa5801a10d0 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fa5680040f0 con 0x7fa58008d8d0 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(104..104 src has 1..104) ==== 6396+0+0 (unknown 4188620942 0 0) 0x7fa56804e7e0 con 0x7fa58008d8d0 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 client.24513.objecter ms_dispatch2 0x7fa580000b90 osd_map(104..104 src has 1..104) 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 3 client.24513.objecter handle_osd_map got epochs [104,104] > 0 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 3 client.24513.objecter handle_osd_map decoding full epoch 104 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 20 client.24513.objecter dump_active .. 0 homeless 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa5740033e0 con 0x7fa5801a10d0 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:46.535 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.43:6789/0 conn(0x7fa5801a10d0 legacy=0x7fa58011ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.43:6789/0 conn(0x7fa5801a10d0 legacy=0x7fa58011ebe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa57f7fe640 10 monclient: get_auth_request con 0x7fa54c03ee60 auth_method 0 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.509+0000 7fa55f7fe640 10 client.24513.objecter ms_handle_connect 0x7fa54c03ee60 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa580107fd0 con 0x7fa580107c00 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 client.24513.objecter ms_handle_connect 0x7fa580107c00 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 client.24513.objecter resend_mon_ops 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255263970 0 0) 0x7fa580107fd0 con 0x7fa580107c00 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.536 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient(hunting): my global_id is 24519 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa58008edd0 con 0x7fa580107c00 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3372398579 0 0) 0x7fa58008edd0 con 0x7fa580107c00 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa580107fd0 con 0x7fa580107c00 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa574003b80 con 0x7fa580107c00 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient: dump: 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.537 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4030129019 0 0) 0x7fa580107fd0 con 0x7fa580107c00 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa58011fa00 con 0x7fa580107c00 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4318 (unknown 0 0 4128863429) 0x7fa574003b60 con 0x7fa580107c00 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:29:46.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:46.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.43:6789/0 conn(0x7fa580107c00 legacy=0x7fa58011f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa55f7fe640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.43:6789/0 conn(0x7fa580107c00 legacy=0x7fa58011f2f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:46.539 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:29:46.539 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:46.539 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:46.539 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:29:46.539 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 10, 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 122143, 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.540 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:29:46.541 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.542 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:29:46.543 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.544 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.545 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.546 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.547 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:29:46.548 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.549 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:29:46.550 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 10 librados: watch_flush enter 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 10 librados: watch_flush exit 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 20 client.24513.objecter shutdown clearing up homeless session... 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 10 client.24513.objecter successfully canceled tick 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.46:6812/860801619 conn(0x7fa54c03ee60 legacy=0x7fa54c05f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 10 monclient: shutdown 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 >> v1:10.20.193.43:6789/0 conn(0x7fa58008d8d0 legacy=0x7fa58018d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa57f7fe640 1 -- 10.20.193.43:0/603037134 reap_dead start 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 shutdown_connections 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 >> 10.20.193.43:0/603037134 conn(0x7fa58008f480 msgr2=0x7fa580121f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 shutdown_connections 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 -- 10.20.193.43:0/603037134 wait complete. 2026-02-21T01:29:46.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.513+0000 7fa5853c0640 1 librados: shutdown 2026-02-21T01:29:46.552 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:29:46.552 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:29:46.552 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.621+0000 7ff69bf71640 10 monclient: get_monmap_and_config 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.621+0000 7ff69bf71640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.621+0000 7ff69bf71640 10 monclient: monmap: 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:46.621874+0000 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:46.621874+0000 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:46.622 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:46.623 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.631 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.621+0000 7ff69bf71640 1 Processor -- start 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.621+0000 7ff69bf71640 1 -- start start 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient: init 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient(hunting): picked mon.noname-c con 0x7ff6940580b0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient(hunting): picked mon.noname-b con 0x7ff694058480 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient(hunting): picked mon.noname-a con 0x7ff694181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6940562b0 con 0x7ff694181e80 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff694056590 con 0x7ff6940580b0 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff694056870 con 0x7ff694058480 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.632 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient(hunting): authenticate will time out at 718.327334s 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff6994e5640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff694058480 0x7ff69408e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34734/0 (socket says 10.20.193.43:34734) 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff6994e5640 1 -- 10.20.193.43:0/2449689991 learned_addr learned my addr 10.20.193.43:0/2449689991 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139575479 0 0) 0x7ff694056870 con 0x7ff694058480 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): my global_id is 74111 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff67c003610 con 0x7ff694058480 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177284773 0 0) 0x7ff6940562b0 con 0x7ff694181e80 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.633 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): my global_id is 24534 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff694056870 con 0x7ff694181e80 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762155162 0 0) 0x7ff694056590 con 0x7ff6940580b0 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient(hunting): my global_id is 28984 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6940562b0 con 0x7ff6940580b0 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 393469862 0 0) 0x7ff67c003610 con 0x7ff694058480 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 >> v1:10.20.193.46:6789/0 conn(0x7ff6940580b0 legacy=0x7ff69408e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 >> v1:10.20.193.43:6789/0 conn(0x7ff694181e80 legacy=0x7ff6941a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 monclient: found mon.noname-b 2026-02-21T01:29:46.634 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6940931d0 con 0x7ff694058480 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff688002df0 con 0x7ff694058480 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: dump: 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.635 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 5 monclient: authenticate success, global_id 74111 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff688003040 con 0x7ff694058480 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 1 -- 10.20.193.43:0/2449689991 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff688003480 con 0x7ff694058480 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:46.636 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff698ce4640 10 monclient: dump: 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.622+0000 7ff69bf71640 4 set_mon_vals no callback set 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient: shutdown 2026-02-21T01:29:46.637 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- 10.20.193.43:0/2449689991 >> v1:10.20.193.43:6790/0 conn(0x7ff694058480 legacy=0x7ff69408e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- 10.20.193.43:0/2449689991 shutdown_connections 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- 10.20.193.43:0/2449689991 >> 10.20.193.43:0/2449689991 conn(0x7ff694094200 msgr2=0x7ff694090180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- 10.20.193.43:0/2449689991 shutdown_connections 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- 10.20.193.43:0/2449689991 wait complete. 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient: monmap: 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:46.638 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 librados: starting msgr at 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 librados: starting objecter 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 Processor -- start 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- start start 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 librados: setting wanted keys 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 librados: calling monclient init 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient: init 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.639 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient(hunting): picked mon.noname-c con 0x7ff6940580b0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient(hunting): picked mon.noname-a con 0x7ff694058480 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 10 monclient(hunting): picked mon.noname-b con 0x7ff694181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff694130380 con 0x7ff694058480 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.623+0000 7ff69bf71640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6941499d0 con 0x7ff694181e80 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69412e2b0 con 0x7ff6940580b0 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 monclient(hunting): authenticate will time out at 718.329007s 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff699ce6640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff6940580b0 0x7ff6941492c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34740/0 (socket says 10.20.193.43:34740) 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff699ce6640 1 -- 10.20.193.43:0/1418814711 learned_addr learned my addr 10.20.193.43:0/1418814711 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 client.?.objecter ms_handle_connect 0x7ff694058480 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 client.?.objecter ms_handle_connect 0x7ff6940580b0 2026-02-21T01:29:46.640 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992866471 0 0) 0x7ff694130380 con 0x7ff694058480 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): my global_id is 24537 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff664003610 con 0x7ff694058480 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582838772 0 0) 0x7ff69412e2b0 con 0x7ff6940580b0 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.641 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): my global_id is 74114 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff694130380 con 0x7ff6940580b0 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1728090837 0 0) 0x7ff694130380 con 0x7ff6940580b0 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff69412e2b0 con 0x7ff6940580b0 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff684003170 con 0x7ff6940580b0 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): dump: 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.642 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2814261928 0 0) 0x7ff664003610 con 0x7ff694058480 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff694130380 con 0x7ff694058480 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff688003390 con 0x7ff694058480 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient(hunting): dump: 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.643 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2704839325 0 0) 0x7ff694130380 con 0x7ff694058480 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.43:6790/0 conn(0x7ff6940580b0 legacy=0x7ff6941492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.46:6789/0 conn(0x7ff694181e80 legacy=0x7ff694171d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 monclient: found mon.a 2026-02-21T01:29:46.644 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69412fdb0 con 0x7ff694058480 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 client.?.objecter ms_handle_connect 0x7ff694181e80 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 5 monclient: authenticate success, global_id 24537 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 monclient: _renew_subs 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff69412e8c0 con 0x7ff694058480 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 client.24537.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:46.645 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 monclient: _renew_subs 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff69412f420 con 0x7ff694058480 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 1 librados: init done 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff688003530 con 0x7ff694058480 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff688004e80 con 0x7ff694058480 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff6827fc640 10 monclient: dump: 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.646 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff683fff640 4 set_mon_vals no callback set 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.624+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff69414c630 con 0x7ff69414c260 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 client.24537.objecter ms_handle_connect 0x7ff69414c260 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 client.24537.objecter resend_mon_ops 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022856701 0 0) 0x7ff69414c630 con 0x7ff69414c260 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.647 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient(hunting): my global_id is 74117 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff694130380 con 0x7ff69414c260 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1515915379 0 0) 0x7ff694130380 con 0x7ff69414c260 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff69414c630 con 0x7ff69414c260 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff684003c60 con 0x7ff69414c260 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient: dump: 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.648 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1006837194 0 0) 0x7ff69414c630 con 0x7ff69414c260 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6940008d0 con 0x7ff69414c260 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff688011800 con 0x7ff694058480 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(105..105 src has 1..105) ==== 5998+0+0 (unknown 1210516165 0 0) 0x7ff68804e440 con 0x7ff694058480 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 client.24537.objecter ms_dispatch2 0x7ff694000b90 osd_map(105..105 src has 1..105) 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 3 client.24537.objecter handle_osd_map got epochs [105,105] > 0 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 3 client.24537.objecter handle_osd_map decoding full epoch 105 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 20 client.24537.objecter dump_active .. 0 homeless 2026-02-21T01:29:46.649 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff6840058b0 con 0x7ff69414c260 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.43:6790/0 conn(0x7ff69414c260 legacy=0x7ff694087f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.43:6790/0 conn(0x7ff69414c260 legacy=0x7ff694087f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.625+0000 7ff69a4e7640 10 monclient: get_auth_request con 0x7ff66403ecd0 auth_method 0 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.626+0000 7ff6827fc640 10 client.24537.objecter ms_handle_connect 0x7ff66403ecd0 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.628+0000 7ff69bf71640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.628+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff69412f710 con 0x7ff69404ca30 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.628+0000 7ff6827fc640 10 client.24537.objecter ms_handle_connect 0x7ff69404ca30 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.628+0000 7ff6827fc640 10 client.24537.objecter resend_mon_ops 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390828639 0 0) 0x7ff69412f710 con 0x7ff69404ca30 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.650 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient(hunting): my global_id is 74120 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69414c630 con 0x7ff69404ca30 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3513311742 0 0) 0x7ff69414c630 con 0x7ff69404ca30 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff69412f710 con 0x7ff69404ca30 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff6840044b0 con 0x7ff69404ca30 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient: dump: 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.651 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2850208098 0 0) 0x7ff69412f710 con 0x7ff69404ca30 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff694092800 con 0x7ff69404ca30 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4146 (unknown 0 0 3352761603) 0x7ff684005b20 con 0x7ff69404ca30 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.43:6790/0 conn(0x7ff69404ca30 legacy=0x7ff6941744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.652 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff6827fc640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.43:6790/0 conn(0x7ff69404ca30 legacy=0x7ff6941744c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 10, 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 367, 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:29:46.653 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.654 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.655 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:29:46.656 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.657 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.658 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.659 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.660 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:29:46.661 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:29:46.662 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 10 librados: watch_flush enter 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 10 librados: watch_flush exit 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 20 client.24537.objecter shutdown clearing up homeless session... 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 10 client.24537.objecter successfully canceled tick 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.46:6812/860801619 conn(0x7ff66403ecd0 legacy=0x7ff66405f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 10 monclient: shutdown 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 >> v1:10.20.193.43:6789/0 conn(0x7ff694058480 legacy=0x7ff694170670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69a4e7640 1 -- 10.20.193.43:0/1418814711 reap_dead start 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69a4e7640 1 -- 10.20.193.43:0/1418814711 reap_dead start 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 shutdown_connections 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 >> 10.20.193.43:0/1418814711 conn(0x7ff694094200 msgr2=0x7ff69408b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 shutdown_connections 2026-02-21T01:29:46.664 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 1 -- 10.20.193.43:0/1418814711 wait complete. 2026-02-21T01:29:46.665 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.629+0000 7ff69bf71640 1 librados: shutdown 2026-02-21T01:29:46.665 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:29:46.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:29:46.665 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.731+0000 7f59de8d7640 10 monclient: get_monmap_and_config 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.731+0000 7f59de8d7640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.731+0000 7f59de8d7640 10 monclient: monmap: 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:46.732202+0000 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:46.732202+0000 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:46.732 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 1 Processor -- start 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 1 -- start start 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient: init 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient(hunting): picked mon.noname-c con 0x7f59d808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient(hunting): picked mon.noname-b con 0x7f59d808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient(hunting): picked mon.noname-a con 0x7f59d808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d808a690 con 0x7f59d808d8d0 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d808b910 con 0x7f59d808ddb0 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d8088ae0 con 0x7f59d808d4d0 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59de8d7640 10 monclient(hunting): authenticate will time out at 718.437583s 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d77fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f59d808d4d0 0x7f59d817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34774/0 (socket says 10.20.193.43:34774) 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d77fe640 1 -- 10.20.193.43:0/2994957450 learned_addr learned my addr 10.20.193.43:0/2994957450 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59dce4d640 1 --1- 10.20.193.43:0/2994957450 >> v1:10.20.193.43:6789/0 conn(0x7f59d808d8d0 0x7f59d819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33032/0 (socket says 10.20.193.43:33032) 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992920041 0 0) 0x7f59d8088ae0 con 0x7f59d808d4d0 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): my global_id is 74123 2026-02-21T01:29:46.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59bc003610 con 0x7f59d808d4d0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231821248 0 0) 0x7f59d808a690 con 0x7f59d808d8d0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): my global_id is 24540 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d8088ae0 con 0x7f59d808d8d0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328625732 0 0) 0x7f59d808b910 con 0x7f59d808ddb0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient(hunting): my global_id is 28987 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d808a690 con 0x7f59d808ddb0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3095011606 0 0) 0x7f59bc003610 con 0x7f59d808d4d0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 >> v1:10.20.193.46:6789/0 conn(0x7f59d808ddb0 legacy=0x7f59d808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 >> v1:10.20.193.43:6789/0 conn(0x7f59d808d8d0 legacy=0x7f59d819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 monclient: found mon.noname-b 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d81a3ef0 con 0x7f59d808d4d0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.732+0000 7f59d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f59c8002df0 con 0x7f59d808d4d0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 10 monclient: dump: 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 5 monclient: authenticate success, global_id 74123 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59c8003000 con 0x7f59d808d4d0 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 1 -- 10.20.193.43:0/2994957450 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f59c8003440 con 0x7f59d808d4d0 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59d6ffd640 10 monclient: dump: 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 4 set_mon_vals no callback set 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 10 monclient: shutdown 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 -- 10.20.193.43:0/2994957450 >> v1:10.20.193.43:6790/0 conn(0x7f59d808d4d0 legacy=0x7f59d817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 -- 10.20.193.43:0/2994957450 shutdown_connections 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 -- 10.20.193.43:0/2994957450 >> 10.20.193.43:0/2994957450 conn(0x7f59d808f480 msgr2=0x7f59d808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 -- 10.20.193.43:0/2994957450 shutdown_connections 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 -- 10.20.193.43:0/2994957450 wait complete. 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 10 monclient: monmap: 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 librados: starting msgr at 2026-02-21T01:29:46.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 librados: starting objecter 2026-02-21T01:29:46.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 Processor -- start 2026-02-21T01:29:46.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 -- start start 2026-02-21T01:29:46.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 librados: setting wanted keys 2026-02-21T01:29:46.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 1 librados: calling monclient init 2026-02-21T01:29:46.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.733+0000 7f59de8d7640 10 monclient: init 2026-02-21T01:29:46.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:46.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient(hunting): picked mon.noname-b con 0x7f59d808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient(hunting): picked mon.noname-c con 0x7f59d808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient(hunting): picked mon.noname-a con 0x7f59d808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d8127d10 con 0x7f59d808ddb0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d8114f60 con 0x7f59d808d4d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d812a070 con 0x7f59d808d8d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient(hunting): authenticate will time out at 718.439183s 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d77fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f59d808d8d0 0x7f59d8126a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34788/0 (socket says 10.20.193.43:34788) 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d77fe640 1 -- 10.20.193.43:0/1981746315 learned_addr learned my addr 10.20.193.43:0/1981746315 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 client.?.objecter ms_handle_connect 0x7f59d808d8d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 client.?.objecter ms_handle_connect 0x7f59d808ddb0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110080198 0 0) 0x7f59d812a070 con 0x7f59d808d8d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): my global_id is 74126 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8003610 con 0x7f59d808d8d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380615050 0 0) 0x7f59d8127d10 con 0x7f59d808ddb0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): my global_id is 24543 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d812a070 con 0x7f59d808ddb0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1931415737 0 0) 0x7f59a8003610 con 0x7f59d808d8d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59d8127d10 con 0x7f59d808d8d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f59c8003350 con 0x7f59d808d8d0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): dump: 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.739 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 593898906 0 0) 0x7f59d812a070 con 0x7f59d808ddb0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a8003610 con 0x7f59d808ddb0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f59cc0033a0 con 0x7f59d808ddb0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient(hunting): dump: 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 client.?.objecter ms_handle_connect 0x7f59d808d4d0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2411155244 0 0) 0x7f59d8127d10 con 0x7f59d808d8d0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.46:6789/0 conn(0x7f59d808d4d0 legacy=0x7f59d81262f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.43:6789/0 conn(0x7f59d808ddb0 legacy=0x7f59d8127110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 monclient: found mon.c 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d81297d0 con 0x7f59d808d8d0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 5 monclient: authenticate success, global_id 74126 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient: _renew_subs 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59d8128870 con 0x7f59d808d8d0 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 client.74126.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:46.740 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient: _renew_subs 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f59d819cab0 con 0x7f59d808d8d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59c8004ce0 con 0x7f59d808d8d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 1 librados: init done 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f59c8005030 con 0x7f59d808d8d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d4ff9640 10 monclient: dump: 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59d67fc640 4 set_mon_vals no callback set 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.734+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f59d805e190 con 0x7f59d81a10d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f59c80119b0 con 0x7f59d808d8d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(105..105 src has 1..105) ==== 5998+0+0 (unknown 1210516165 0 0) 0x7f59c804e5d0 con 0x7f59d808d8d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 client.74126.objecter ms_dispatch2 0x7f59d8000b90 osd_map(105..105 src has 1..105) 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 3 client.74126.objecter handle_osd_map got epochs [105,105] > 0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 3 client.74126.objecter handle_osd_map decoding full epoch 105 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 20 client.74126.objecter dump_active .. 0 homeless 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 client.74126.objecter ms_handle_connect 0x7f59d81a10d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 client.74126.objecter resend_mon_ops 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59dce4d640 10 monclient: get_auth_request con 0x7f59a803eb00 auth_method 0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497414453 0 0) 0x7f59d805e190 con 0x7f59d81a10d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 monclient(hunting): my global_id is 28990 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d8127d10 con 0x7f59d81a10d0 2026-02-21T01:29:46.741 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3361728249 0 0) 0x7f59d8127d10 con 0x7f59d81a10d0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59d805e190 con 0x7f59d81a10d0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f59c4002f20 con 0x7f59d81a10d0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 monclient: dump: 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 10 client.74126.objecter ms_handle_connect 0x7f59a803eb00 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 199606161 0 0) 0x7f59d805e190 con 0x7f59d81a10d0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.735+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59d805c160 con 0x7f59d81a10d0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.736+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f59c4003350 con 0x7f59d81a10d0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.736+0000 7f59d4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.736+0000 7f59d4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.736+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.46:6789/0 conn(0x7f59d81a10d0 legacy=0x7f59d8121b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.742 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.736+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.46:6789/0 conn(0x7f59d81a10d0 legacy=0x7f59d8121b90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.739+0000 7f59de8d7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.739+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f59d8054ff0 con 0x7f59d81222a0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.739+0000 7f59d4ff9640 10 client.74126.objecter ms_handle_connect 0x7f59d81222a0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.739+0000 7f59d4ff9640 10 client.74126.objecter resend_mon_ops 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3630188374 0 0) 0x7f59d8054ff0 con 0x7f59d81222a0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient(hunting): my global_id is 28993 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d805e190 con 0x7f59d81222a0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4249127213 0 0) 0x7f59d805e190 con 0x7f59d81222a0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59d8054ff0 con 0x7f59d81222a0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f59c40038f0 con 0x7f59d81222a0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient: dump: 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.743 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3808282865 0 0) 0x7f59d8054ff0 con 0x7f59d81222a0 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59d812fcf0 con 0x7f59d81222a0 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4484 (unknown 0 0 4033830591) 0x7f59c4004730 con 0x7f59d81222a0 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.46:6789/0 conn(0x7f59d81222a0 legacy=0x7f59d812d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59d4ff9640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.46:6789/0 conn(0x7f59d81222a0 legacy=0x7f59d812d5c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 10, 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 122333, 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:29:46.744 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.745 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:29:46.746 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:46.747 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.748 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:46.749 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:46.750 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "num": 10 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:46.751 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:46.752 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:29:46.752 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 10 librados: watch_flush enter 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 10 librados: watch_flush exit 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 20 client.74126.objecter shutdown clearing up homeless session... 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 10 client.74126.objecter successfully canceled tick 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.46:6812/860801619 conn(0x7f59a803eb00 legacy=0x7f59a805efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 10 monclient: shutdown 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 >> v1:10.20.193.43:6790/0 conn(0x7f59d808d8d0 legacy=0x7f59d8126a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59dce4d640 1 -- 10.20.193.43:0/1981746315 reap_dead start 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59dce4d640 1 -- 10.20.193.43:0/1981746315 reap_dead start 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 shutdown_connections 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 >> 10.20.193.43:0/1981746315 conn(0x7f59d808f480 msgr2=0x7f59d81a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 shutdown_connections 2026-02-21T01:29:46.753 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 1 -- 10.20.193.43:0/1981746315 wait complete. 2026-02-21T01:29:46.754 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.740+0000 7f59de8d7640 1 librados: shutdown 2026-02-21T01:29:46.754 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:29:46.754 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-21T01:29:46.754 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.819+0000 7f26e2cc6640 10 monclient: get_monmap_and_config 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.819+0000 7f26e2cc6640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.819+0000 7f26e2cc6640 10 monclient: monmap: 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:46.819958+0000 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:46.819958+0000 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.820 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.821 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.821 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:46.821 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:46.821 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.819+0000 7f26e2cc6640 1 Processor -- start 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 1 -- start start 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient: init 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient(hunting): picked mon.noname-c con 0x7f26dc08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient(hunting): picked mon.noname-b con 0x7f26dc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient(hunting): picked mon.noname-a con 0x7f26dc08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc08a690 con 0x7f26dc08d8d0 2026-02-21T01:29:46.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc08b910 con 0x7f26dc08ddb0 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc088ae0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient(hunting): authenticate will time out at 718.525346s 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d3fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 0x7f26dc17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34792/0 (socket says 10.20.193.43:34792) 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d3fff640 1 -- 10.20.193.43:0/82146206 learned_addr learned my addr 10.20.193.43:0/82146206 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151876797 0 0) 0x7f26dc088ae0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): my global_id is 74129 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c8003610 con 0x7f26dc08d4d0 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707790828 0 0) 0x7f26dc08a690 con 0x7f26dc08d8d0 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient(hunting): my global_id is 24546 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26dc088ae0 con 0x7f26dc08d8d0 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1583873240 0 0) 0x7f26c8003610 con 0x7f26dc08d4d0 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 >> v1:10.20.193.46:6789/0 conn(0x7f26dc08ddb0 legacy=0x7f26dc08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 >> v1:10.20.193.43:6789/0 conn(0x7f26dc08d8d0 legacy=0x7f26dc19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 monclient: found mon.noname-b 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc1a3ef0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f26c4002df0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: dump: 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.830 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 5 monclient: authenticate success, global_id 74129 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26c4003070 con 0x7f26dc08d4d0 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 1 -- 10.20.193.43:0/82146206 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f26c40034b0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26d37fe640 10 monclient: dump: 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:46.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.820+0000 7f26e2cc6640 4 set_mon_vals no callback set 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient: shutdown 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- 10.20.193.43:0/82146206 >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 legacy=0x7f26dc17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- 10.20.193.43:0/82146206 shutdown_connections 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- 10.20.193.43:0/82146206 >> 10.20.193.43:0/82146206 conn(0x7f26dc08f480 msgr2=0x7f26dc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- 10.20.193.43:0/82146206 shutdown_connections 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- 10.20.193.43:0/82146206 wait complete. 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient: build_initial_monmap 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient: monmap: 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 librados: starting msgr at 2026-02-21T01:29:46.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 librados: starting objecter 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 Processor -- start 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- start start 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 librados: setting wanted keys 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 librados: calling monclient init 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient: init 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient(hunting): picked mon.noname-c con 0x7f26dc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient(hunting): picked mon.noname-b con 0x7f26dc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient(hunting): picked mon.noname-a con 0x7f26dc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc05e1b0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc05c510 con 0x7f26dc08d8d0 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26dc107e70 con 0x7f26dc08d4d0 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e2cc6640 10 monclient(hunting): authenticate will time out at 718.526899s 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e0a3b640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 0x7f26dc11bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34802/0 (socket says 10.20.193.43:34802) 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26e0a3b640 1 -- 10.20.193.43:0/1446766102 learned_addr learned my addr 10.20.193.43:0/1446766102 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26d17fa640 10 client.?.objecter ms_handle_connect 0x7f26dc08d4d0 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26d17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26d17fa640 10 client.?.objecter ms_handle_connect 0x7f26dc08ddb0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.821+0000 7f26d17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307215896 0 0) 0x7f26dc107e70 con 0x7f26dc08d4d0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): my global_id is 74132 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26ac003610 con 0x7f26dc08d4d0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240076427 0 0) 0x7f26dc05e1b0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): my global_id is 24549 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26dc107e70 con 0x7f26dc08ddb0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 381832189 0 0) 0x7f26ac003610 con 0x7f26dc08d4d0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26dc05e1b0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.?.objecter ms_handle_connect 0x7f26dc08d8d0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f26cc003190 con 0x7f26dc08d4d0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): dump: 2026-02-21T01:29:46.834 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 147818801 0 0) 0x7f26dc107e70 con 0x7f26dc08ddb0 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26ac003610 con 0x7f26dc08ddb0 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f26d80033b0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): dump: 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.835 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2681544710 0 0) 0x7f26dc05e1b0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.46:6789/0 conn(0x7f26dc08d8d0 legacy=0x7f26dc18b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6789/0 conn(0x7f26dc08ddb0 legacy=0x7f26dc18cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 monclient: found mon.c 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc108710 con 0x7f26dc08d4d0 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 5 monclient: authenticate success, global_id 74132 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 10 monclient: _renew_subs 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc106f10 con 0x7f26dc08d4d0 2026-02-21T01:29:46.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e0a3b640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 legacy=0x7f26dc11bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e0a3b640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 legacy=0x7f26dc11bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e0a3b640 1 --1- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 0x7f26dc11bd60 :-1 s=OPENED pgs=34 cs=1 l=1).handle_message read tag failed 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 10 client.74132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 10 monclient: _renew_subs 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e0a3b640 1 --1- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 0x7f26dc11bd60 :-1 s=OPENED pgs=34 cs=1 l=1).fault on lossy channel, failing 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f26dc05bcd0 con 0x7f26dc08d4d0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 1 librados: init done 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: ms_handle_reset current mon v1:10.20.193.43:6790/0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6790/0 conn(0x7f26dc08d4d0 legacy=0x7f26dc11bd60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): picked mon.b con 0x7f26dc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): picked mon.c con 0x7f26ac004450 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): picked mon.a con 0x7f26dc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f26dc05e1b0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f26ac003610 con 0x7f26dc08d8d0 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f26dc107e70 con 0x7f26ac004450 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.74132.objecter ms_handle_connect 0x7f26ac004450 2026-02-21T01:29:46.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.74132.objecter resend_mon_ops 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.74132.objecter ms_handle_connect 0x7f26dc08ddb0 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.74132.objecter resend_mon_ops 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444574219 0 0) 0x7f26dc05e1b0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f26ac06a280 con 0x7f26dc08ddb0 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959719365 0 0) 0x7f26dc107e70 con 0x7f26ac004450 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f26dc05e1b0 con 0x7f26ac004450 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.74132.objecter ms_handle_connect 0x7f26dc08d8d0 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 client.74132.objecter resend_mon_ops 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2771492089 0 0) 0x7f26ac06a280 con 0x7f26dc08ddb0 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6790/0 conn(0x7f26ac004450 legacy=0x7f26ac046aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.46:6789/0 conn(0x7f26dc08d8d0 legacy=0x7f26ac003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _finish_hunting 0 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 monclient: found mon.a 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f26ac06d5d0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _finish_auth 0 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: _check_auth_tickets 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f26d8003c20 con 0x7f26dc08ddb0 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: dump: 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26d8003dc0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d17fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26d2ffd640 4 set_mon_vals no callback set 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.822+0000 7f26e2cc6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26e2cc6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26e2cc6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26dc05bcd0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f26d8010750 con 0x7f26dc08ddb0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 6 ==== osd_map(105..105 src has 1..105) ==== 5998+0+0 (unknown 1210516165 0 0) 0x7f26d804d830 con 0x7f26dc08ddb0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26d17fa640 10 client.74132.objecter ms_dispatch2 0x7f26dc000b90 osd_map(105..105 src has 1..105) 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26d17fa640 3 client.74132.objecter handle_osd_map got epochs [105,105] > 0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26d17fa640 3 client.74132.objecter handle_osd_map decoding full epoch 105 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26d17fa640 20 client.74132.objecter dump_active .. 0 homeless 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26e0a3b640 10 monclient: get_auth_request con 0x7f26dc08d4d0 auth_method 0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.823+0000 7f26d17fa640 10 client.74132.objecter ms_handle_connect 0x7f26dc08d4d0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.825+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f26d8016920 con 0x7f26dc08ddb0 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.825+0000 7f26d17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:46.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.825+0000 7f26d17fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:46.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.977+0000 7f26e2cc6640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-21T01:29:46.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.977+0000 7f26e2cc6640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-21T01:29:46.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.977+0000 7f26e2cc6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:46.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.977+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f26dc08edb0 con 0x7f26dc08ddb0 2026-02-21T01:29:46.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.977+0000 7f26d17fa640 1 -- 10.20.193.43:0/1446766102 <== mon.0 v1:10.20.193.43:6789/0 8 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f26d8016220 con 0x7f26dc08ddb0 2026-02-21T01:29:46.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.977+0000 7f26d17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-21T01:29:46.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.977+0000 7f26d17fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:46.979 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.979 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=563034936,config=3140514009,health=1796179531,kv=1200173230,logm=293041909}) 2026-02-21T01:29:46.979 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=12,kv=8,logm=66} crc {auth=117455408,config=3140514009,health=418948704,kv=4032833782,logm=3221241819}) 2026-02-21T01:29:46.979 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.979 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=563034936,config=3140514009,health=1796179531,kv=1200173230,logm=293041909}) 2026-02-21T01:29:46.979 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=13,kv=10,logm=63} crc {auth=3680373463,config=3140514009,health=1796179531,kv=62098668,logm=195907706}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2631115815}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3345779687}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2631115815}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.978+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3596112490}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731585260}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3166197088}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731585260}) 2026-02-21T01:29:46.980 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3216909153}) 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 10 librados: watch_flush enter 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 10 librados: watch_flush exit 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 20 client.74132.objecter shutdown clearing up homeless session... 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 10 client.74132.objecter successfully canceled tick 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.46:6812/860801619 conn(0x7f26dc08d4d0 legacy=0x7f26ac0c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 10 monclient: shutdown 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 >> v1:10.20.193.43:6789/0 conn(0x7f26dc08ddb0 legacy=0x7f26ac068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 shutdown_connections 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 >> 10.20.193.43:0/1446766102 conn(0x7f26dc08f480 msgr2=0x7f26dc11f550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 shutdown_connections 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 1 -- 10.20.193.43:0/1446766102 wait complete. 2026-02-21T01:29:46.981 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.981 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2087043365}) 2026-02-21T01:29:46.981 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2866504789}) 2026-02-21T01:29:46.981 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:46.979+0000 7f26e2cc6640 1 librados: shutdown 2026-02-21T01:29:46.983 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2087043365}) 2026-02-21T01:29:46.983 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.979+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3733258783}) 2026-02-21T01:29:46.983 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3694148012}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2946500458}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3694148012}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4100703376}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=709398351}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3834045077}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=709398351}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3261602115}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3480843244}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1722503152}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3480843244}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.980+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2908264007}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3296239189}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2018090400}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3296239189}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1489246867}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684087277}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=183673959}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684087277}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2821470335}) 2026-02-21T01:29:46.984 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924450619}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=121033347}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924450619}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.981+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2216209560}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2788393919}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=47281428}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2788393919}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1669803167}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158719542}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=22525137}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158719542}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3034774824}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405943036}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3465455660}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405943036}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.982+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3233769091}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675028927}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3992406775}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675028927}) 2026-02-21T01:29:46.985 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=619778367}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13,osdmap=29} crc {logm=16835598,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=4187050511,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=3321968133,osd_snap=1807077560,osdmap=2159987026}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=18,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=6,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=14,osdmap=28} crc {logm=1363444150,mdsmap=3068764153,mgr=3394679465,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=4287583083,mon_config_key=1206199691,monmap=4257464702,nvmeofgw=3140514009,osd_metadata=2108339561,osd_pg_creating=3321968133,osd_snap=1520838206,osdmap=3281699707}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13,osdmap=29} crc {logm=16835598,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=4187050511,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=3321968133,osd_snap=1807077560,osdmap=2159987026}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.983+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=15,osdmap=28} crc {logm=1594483313,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=4287583083,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=3321968133,osd_snap=1486523431,osdmap=2784890560}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.984+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.984+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1180116705}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.984+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2958899469}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.984+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.984+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1180116705}) 2026-02-21T01:29:46.986 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.984+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2005237727}) 2026-02-21T01:29:46.987 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.985+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.987 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.985+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=40} crc {osdmap=2588744216}) 2026-02-21T01:29:46.987 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.985+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=37} crc {osdmap=3187538506}) 2026-02-21T01:29:46.987 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.985+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:29:46.987 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.985+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=40} crc {osdmap=2588744216}) 2026-02-21T01:29:46.987 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:29:46.985+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=39} crc {osdmap=4257386714}) 2026-02-21T01:29:46.987 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-21T01:29:47.989 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:29:47.989 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:29:48.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient: get_monmap_and_config 2026-02-21T01:29:48.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient: monmap: 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:48.057520+0000 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:48.057520+0000 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:48.058 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 1 Processor -- start 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 1 -- start start 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient: init 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient(hunting): picked mon.noname-a con 0x7f558005cef0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient(hunting): picked mon.noname-c con 0x7f558008a730 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient(hunting): picked mon.noname-b con 0x7f558013fa20 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f558005d9d0 con 0x7f558005cef0 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f558008b590 con 0x7f558008a730 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f558005b9c0 con 0x7f558013fa20 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f55857cb640 10 monclient(hunting): authenticate will time out at 719.762904s 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f557effd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f558005cef0 0x7f558005d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33082/0 (socket says 10.20.193.43:33082) 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.057+0000 7f557effd640 1 -- 10.20.193.43:0/1886510671 learned_addr learned my addr 10.20.193.43:0/1886510671 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668239186 0 0) 0x7f558005b9c0 con 0x7f558013fa20 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): my global_id is 74135 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f556c003610 con 0x7f558013fa20 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253471650 0 0) 0x7f558005d9d0 con 0x7f558005cef0 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient(hunting): my global_id is 24552 2026-02-21T01:29:48.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f558005b9c0 con 0x7f558005cef0 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 282246072 0 0) 0x7f556c003610 con 0x7f558013fa20 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 >> v1:10.20.193.46:6789/0 conn(0x7f558008a730 legacy=0x7f5580180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 >> v1:10.20.193.43:6789/0 conn(0x7f558005cef0 legacy=0x7f558005d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 monclient: found mon.noname-b 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558013f210 con 0x7f558013fa20 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5570003170 con 0x7f558013fa20 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: dump: 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 5 monclient: authenticate success, global_id 74135 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5570003470 con 0x7f558013fa20 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 4 set_mon_vals no callback set 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 1 -- 10.20.193.43:0/1886510671 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f55700038b0 con 0x7f558013fa20 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f557dffb640 10 monclient: dump: 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.060 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 10 monclient: shutdown 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 1 -- 10.20.193.43:0/1886510671 >> v1:10.20.193.43:6790/0 conn(0x7f558013fa20 legacy=0x7f55801a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 1 -- 10.20.193.43:0/1886510671 shutdown_connections 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 1 -- 10.20.193.43:0/1886510671 >> 10.20.193.43:0/1886510671 conn(0x7f558008f480 msgr2=0x7f558008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 1 -- 10.20.193.43:0/1886510671 shutdown_connections 2026-02-21T01:29:48.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.058+0000 7f55857cb640 1 -- 10.20.193.43:0/1886510671 wait complete. 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient: monmap: 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 librados: starting msgr at 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 librados: starting objecter 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 Processor -- start 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 -- start start 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 librados: setting wanted keys 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 librados: calling monclient init 2026-02-21T01:29:48.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient: init 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient(hunting): picked mon.noname-b con 0x7f558005cef0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient(hunting): picked mon.noname-a con 0x7f558008a730 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient(hunting): picked mon.noname-c con 0x7f558013fa20 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5580108530 con 0x7f558008a730 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55801072f0 con 0x7f558005cef0 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5580108db0 con 0x7f558013fa20 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f55857cb640 10 monclient(hunting): authenticate will time out at 719.764671s 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f557e7fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f558008a730 0x7f55801a0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33090/0 (socket says 10.20.193.43:33090) 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f557f7fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f558013fa20 0x7f55801a1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34836/0 (socket says 10.20.193.43:34836) 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f557e7fc640 1 -- 10.20.193.43:0/1453434223 learned_addr learned my addr 10.20.193.43:0/1453434223 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 client.?.objecter ms_handle_connect 0x7f558013fa20 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 client.?.objecter ms_handle_connect 0x7f558008a730 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445147878 0 0) 0x7f5580108db0 con 0x7f558013fa20 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): my global_id is 74138 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554c003610 con 0x7f558013fa20 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053609072 0 0) 0x7f5580108530 con 0x7f558008a730 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): my global_id is 24555 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5580108db0 con 0x7f558008a730 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2890688108 0 0) 0x7f554c003610 con 0x7f558013fa20 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5580108530 con 0x7f558013fa20 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5570003620 con 0x7f558013fa20 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): dump: 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.063 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2540270537 0 0) 0x7f5580108db0 con 0x7f558008a730 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f554c003610 con 0x7f558008a730 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5568003050 con 0x7f558008a730 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.059+0000 7f555f7fe640 10 monclient(hunting): dump: 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 client.?.objecter ms_handle_connect 0x7f558005cef0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2837735622 0 0) 0x7f5580108530 con 0x7f558013fa20 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 >> v1:10.20.193.46:6789/0 conn(0x7f558005cef0 legacy=0x7f558013b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 >> v1:10.20.193.43:6789/0 conn(0x7f558008a730 legacy=0x7f55801a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 monclient: found mon.c 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5580109650 con 0x7f558013fa20 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 5 monclient: authenticate success, global_id 74138 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 monclient: _renew_subs 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5580107e50 con 0x7f558013fa20 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 client.74138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 monclient: _renew_subs 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f558013bf40 con 0x7f558013fa20 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 1 librados: init done 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55700033e0 con 0x7f558013fa20 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5570004060 con 0x7f558013fa20 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f557d7fa640 4 set_mon_vals no callback set 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 monclient: dump: 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558005e190 con 0x7f558013fa20 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f5570004200 con 0x7f558013fa20 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(106..106 src has 1..106) ==== 6805+0+0 (unknown 2767964192 0 0) 0x7f557004ec00 con 0x7f558013fa20 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 10 client.74138.objecter ms_dispatch2 0x7f5580000b90 osd_map(106..106 src has 1..106) 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 3 client.74138.objecter handle_osd_map got epochs [106,106] > 0 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 3 client.74138.objecter handle_osd_map decoding full epoch 106 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f555f7fe640 20 client.74138.objecter dump_active .. 0 homeless 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.060+0000 7f557effd640 10 monclient: get_auth_request con 0x7f554c03e9d0 auth_method 0 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.061+0000 7f555f7fe640 10 client.74138.objecter ms_handle_connect 0x7f554c03e9d0 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.063+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f558005e190 con 0x7f558013fa20 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.063+0000 7f555f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.063+0000 7f555f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.211+0000 7f55857cb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.211+0000 7f55857cb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.211+0000 7f55857cb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.211+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f558013c2d0 con 0x7f558013fa20 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.211+0000 7f555f7fe640 1 -- 10.20.193.43:0/1453434223 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 687440444) 0x7f5570017960 con 0x7f558013fa20 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.211+0000 7f555f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.211+0000 7f555f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:48.212 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 10 librados: watch_flush enter 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 10 librados: watch_flush exit 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 20 client.74138.objecter shutdown clearing up homeless session... 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 10 client.74138.objecter successfully canceled tick 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 >> v1:10.20.193.46:6812/860801619 conn(0x7f554c03e9d0 legacy=0x7f554c05ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 10 monclient: shutdown 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 >> v1:10.20.193.43:6790/0 conn(0x7f558013fa20 legacy=0x7f55801a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 shutdown_connections 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 >> 10.20.193.43:0/1453434223 conn(0x7f558008f480 msgr2=0x7f558008bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 shutdown_connections 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 1 -- 10.20.193.43:0/1453434223 wait complete. 2026-02-21T01:29:48.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.212+0000 7f55857cb640 1 librados: shutdown 2026-02-21T01:29:48.221 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:29:48.221 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-21T01:29:48.221 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:29:48.221 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:29:48.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.287+0000 7f808a39b640 10 monclient: get_monmap_and_config 2026-02-21T01:29:48.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.287+0000 7f808a39b640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.287+0000 7f808a39b640 10 monclient: monmap: 2026-02-21T01:29:48.296 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.296 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.296 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:48.288344+0000 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:48.288344+0000 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 1 Processor -- start 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 1 -- start start 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient: init 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient(hunting): picked mon.noname-b con 0x7f808408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient(hunting): picked mon.noname-a con 0x7f808408d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient(hunting): picked mon.noname-c con 0x7f808408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808408a690 con 0x7f808408d4d0 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808408b910 con 0x7f808408d8d0 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8084088ae0 con 0x7f808408ddb0 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f808a39b640 10 monclient(hunting): authenticate will time out at 719.993760s 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8083fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f808408ddb0 0x7f808408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34846/0 (socket says 10.20.193.43:34846) 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8083fff640 1 -- 10.20.193.43:0/4131582445 learned_addr learned my addr 10.20.193.43:0/4131582445 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f80837fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f808408d4d0 0x7f808417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33098/0 (socket says 10.20.193.43:33098) 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774468925 0 0) 0x7f808408a690 con 0x7f808408d4d0 2026-02-21T01:29:48.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8082ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8082ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8082ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8082ffd640 10 monclient(hunting): my global_id is 24558 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8068003610 con 0x7f808408d4d0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.288+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643332928 0 0) 0x7f8084088ae0 con 0x7f808408ddb0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient(hunting): my global_id is 74141 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f808408a690 con 0x7f808408ddb0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990462597 0 0) 0x7f8068003610 con 0x7f808408d4d0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 >> v1:10.20.193.43:6790/0 conn(0x7f808408ddb0 legacy=0x7f808408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 >> v1:10.20.193.46:6789/0 conn(0x7f808408d8d0 legacy=0x7f808419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 monclient: found mon.noname-a 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80841a3ef0 con 0x7f808408d4d0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8074002df0 con 0x7f808408d4d0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:48.298 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: dump: 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 5 monclient: authenticate success, global_id 24558 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80740030b0 con 0x7f808408d4d0 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 1 -- 10.20.193.43:0/4131582445 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f80740034f0 con 0x7f808408d4d0 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f8082ffd640 10 monclient: dump: 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.299 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 4 set_mon_vals no callback set 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 10 monclient: shutdown 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 1 -- 10.20.193.43:0/4131582445 >> v1:10.20.193.43:6789/0 conn(0x7f808408d4d0 legacy=0x7f808417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 1 -- 10.20.193.43:0/4131582445 shutdown_connections 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 1 -- 10.20.193.43:0/4131582445 >> 10.20.193.43:0/4131582445 conn(0x7f808408f480 msgr2=0x7f808408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 1 -- 10.20.193.43:0/4131582445 shutdown_connections 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 1 -- 10.20.193.43:0/4131582445 wait complete. 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 10 monclient: monmap: 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 1 librados: starting msgr at 2026-02-21T01:29:48.300 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.289+0000 7f808a39b640 1 librados: starting objecter 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 Processor -- start 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 -- start start 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 librados: setting wanted keys 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 librados: calling monclient init 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient: init 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient(hunting): picked mon.noname-b con 0x7f808408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient(hunting): picked mon.noname-c con 0x7f808408d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient(hunting): picked mon.noname-a con 0x7f808408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8084128bf0 con 0x7f808408ddb0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8084128ed0 con 0x7f808408d4d0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808405e1b0 con 0x7f808408d8d0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient(hunting): authenticate will time out at 719.995313s 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f80837fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f808408d8d0 0x7f808419a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34858/0 (socket says 10.20.193.43:34858) 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f80837fe640 1 -- 10.20.193.43:0/2567291617 learned_addr learned my addr 10.20.193.43:0/2567291617 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8088911640 1 --1- 10.20.193.43:0/2567291617 >> v1:10.20.193.43:6789/0 conn(0x7f808408ddb0 0x7f808419c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33114/0 (socket says 10.20.193.43:33114) 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 client.?.objecter ms_handle_connect 0x7f808408d8d0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 client.?.objecter ms_handle_connect 0x7f808408ddb0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081146114 0 0) 0x7f808405e1b0 con 0x7f808408d8d0 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.301 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): my global_id is 74144 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8054003610 con 0x7f808408d8d0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286404017 0 0) 0x7f8084128bf0 con 0x7f808408ddb0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): my global_id is 24561 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f808405e1b0 con 0x7f808408ddb0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2112213847 0 0) 0x7f8054003610 con 0x7f808408d8d0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8084128bf0 con 0x7f808408d8d0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8074002db0 con 0x7f808408d8d0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): dump: 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:48.302 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 866523768 0 0) 0x7f808405e1b0 con 0x7f808408ddb0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8054003610 con 0x7f808408ddb0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8078004310 con 0x7f808408ddb0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient(hunting): dump: 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2039063185 0 0) 0x7f8084128bf0 con 0x7f808408d8d0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.46:6789/0 conn(0x7f808408d4d0 legacy=0x7f80841129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.43:6789/0 conn(0x7f808408ddb0 legacy=0x7f808419c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 monclient: found mon.c 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8084128910 con 0x7f808408d8d0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.303 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 client.?.objecter ms_handle_connect 0x7f808408d4d0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 5 monclient: authenticate success, global_id 74144 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient: _renew_subs 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8084139e80 con 0x7f808408d8d0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 client.74144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient: _renew_subs 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8084087750 con 0x7f808408d8d0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f808a39b640 1 librados: init done 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8074002960 con 0x7f808408d8d0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8074004ca0 con 0x7f808408d8d0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f8080ff9640 10 monclient: dump: 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.304 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.290+0000 7f80827fc640 4 set_mon_vals no callback set 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f808a39b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f808408edb0 con 0x7f80841a10d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 client.74144.objecter ms_handle_connect 0x7f80841a10d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 client.74144.objecter resend_mon_ops 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f8074004e40 con 0x7f808408d8d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872270467 0 0) 0x7f808408edb0 con 0x7f80841a10d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient(hunting): my global_id is 24564 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8084128bf0 con 0x7f80841a10d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(106..106 src has 1..106) ==== 6805+0+0 (unknown 2767964192 0 0) 0x7f807404e940 con 0x7f808408d8d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 client.74144.objecter ms_dispatch2 0x7f8084000b90 osd_map(106..106 src has 1..106) 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 3 client.74144.objecter handle_osd_map got epochs [106,106] > 0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 3 client.74144.objecter handle_osd_map decoding full epoch 106 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 20 client.74144.objecter dump_active .. 0 homeless 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2615767666 0 0) 0x7f8084128bf0 con 0x7f80841a10d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f808408edb0 con 0x7f80841a10d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8070003020 con 0x7f80841a10d0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient: dump: 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.305 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8088911640 10 monclient: get_auth_request con 0x7f805403e930 auth_method 0 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1571183956 0 0) 0x7f808408edb0 con 0x7f80841a10d0 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f808408c750 con 0x7f80841a10d0 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8070002d00 con 0x7f80841a10d0 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.43:6789/0 conn(0x7f80841a10d0 legacy=0x7f808405a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.43:6789/0 conn(0x7f80841a10d0 legacy=0x7f808405a3a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.291+0000 7f8080ff9640 10 client.74144.objecter ms_handle_connect 0x7f805403e930 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8084054ff0 con 0x7f8084113100 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 client.74144.objecter ms_handle_connect 0x7f8084113100 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 client.74144.objecter resend_mon_ops 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576033947 0 0) 0x7f8084054ff0 con 0x7f8084113100 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.306 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient(hunting): my global_id is 24567 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f808408edb0 con 0x7f8084113100 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1053215826 0 0) 0x7f808408edb0 con 0x7f8084113100 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8084054ff0 con 0x7f8084113100 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8070004a70 con 0x7f8084113100 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient: dump: 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3104851426 0 0) 0x7f8084054ff0 con 0x7f8084113100 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8084113500 con 0x7f8084113100 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4318 (unknown 0 0 4271971987) 0x7f8070005ec0 con 0x7f8084113100 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.43:6789/0 conn(0x7f8084113100 legacy=0x7f808404ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.307 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8080ff9640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.43:6789/0 conn(0x7f8084113100 legacy=0x7f808404ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 10, 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 123925, 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.308 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.309 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.310 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.311 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.312 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.313 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:29:48.314 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 10 librados: watch_flush enter 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 10 librados: watch_flush exit 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 20 client.74144.objecter shutdown clearing up homeless session... 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 10 client.74144.objecter successfully canceled tick 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.46:6812/860801619 conn(0x7f805403e930 legacy=0x7f805405ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 10 monclient: shutdown 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 >> v1:10.20.193.43:6790/0 conn(0x7f808408d8d0 legacy=0x7f808419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8088911640 1 -- 10.20.193.43:0/2567291617 reap_dead start 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f8088911640 1 -- 10.20.193.43:0/2567291617 reap_dead start 2026-02-21T01:29:48.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 shutdown_connections 2026-02-21T01:29:48.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 >> 10.20.193.43:0/2567291617 conn(0x7f808408f480 msgr2=0x7f80841a3120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 shutdown_connections 2026-02-21T01:29:48.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 -- 10.20.193.43:0/2567291617 wait complete. 2026-02-21T01:29:48.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.295+0000 7f808a39b640 1 librados: shutdown 2026-02-21T01:29:48.316 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:29:48.316 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:29:48.316 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.383+0000 7f2829dc3640 10 monclient: get_monmap_and_config 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.383+0000 7f2829dc3640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.383+0000 7f2829dc3640 10 monclient: monmap: 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:48.384218+0000 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:48.384218+0000 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:48.384 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 1 Processor -- start 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 1 -- start start 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient: init 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient(hunting): picked mon.noname-a con 0x7f282408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient(hunting): picked mon.noname-b con 0x7f282408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient(hunting): picked mon.noname-c con 0x7f282408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282408a690 con 0x7f282408ddb0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282408b910 con 0x7f282408d8d0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2824088ae0 con 0x7f282408d4d0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f2829dc3640 10 monclient(hunting): authenticate will time out at 720.089669s 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28237fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f282408ddb0 0x7f282408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33144/0 (socket says 10.20.193.43:33144) 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28237fe640 1 -- 10.20.193.43:0/1691704562 learned_addr learned my addr 10.20.193.43:0/1691704562 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297387484 0 0) 0x7f2824088ae0 con 0x7f282408d4d0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): my global_id is 74147 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2808003610 con 0x7f282408d4d0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416146149 0 0) 0x7f282408a690 con 0x7f282408ddb0 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 10 monclient(hunting): my global_id is 24570 2026-02-21T01:29:48.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.384+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2824088ae0 con 0x7f282408ddb0 2026-02-21T01:29:48.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1479204394 0 0) 0x7f2808003610 con 0x7f282408d4d0 2026-02-21T01:29:48.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 >> v1:10.20.193.46:6789/0 conn(0x7f282408d8d0 legacy=0x7f282419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 >> v1:10.20.193.43:6789/0 conn(0x7f282408ddb0 legacy=0x7f282408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 monclient: found mon.noname-b 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28241a3ef0 con 0x7f282408d4d0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2814002df0 con 0x7f282408d4d0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 5 monclient: authenticate success, global_id 74147 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: dump: 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28140030b0 con 0x7f282408d4d0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 1 -- 10.20.193.43:0/1691704562 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f28140034f0 con 0x7f282408d4d0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f28227fc640 10 monclient: dump: 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.390 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 4 set_mon_vals no callback set 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 10 monclient: shutdown 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 1 -- 10.20.193.43:0/1691704562 >> v1:10.20.193.43:6790/0 conn(0x7f282408d4d0 legacy=0x7f282417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 1 -- 10.20.193.43:0/1691704562 shutdown_connections 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 1 -- 10.20.193.43:0/1691704562 >> 10.20.193.43:0/1691704562 conn(0x7f282408f480 msgr2=0x7f282408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 1 -- 10.20.193.43:0/1691704562 shutdown_connections 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 1 -- 10.20.193.43:0/1691704562 wait complete. 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 10 monclient: monmap: 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 1 librados: starting msgr at 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.385+0000 7f2829dc3640 1 librados: starting objecter 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 Processor -- start 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 -- start start 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 librados: setting wanted keys 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 librados: calling monclient init 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient: init 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient(hunting): picked mon.noname-c con 0x7f282408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient(hunting): picked mon.noname-a con 0x7f282408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient(hunting): picked mon.noname-b con 0x7f282408ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2824109680 con 0x7f282408d8d0 2026-02-21T01:29:48.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2824056fc0 con 0x7f282408ddb0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282405e1b0 con 0x7f282408d4d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient(hunting): authenticate will time out at 720.091343s 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f28237fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f282408d4d0 0x7f282411dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34882/0 (socket says 10.20.193.43:34882) 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f28237fe640 1 -- 10.20.193.43:0/204409600 learned_addr learned my addr 10.20.193.43:0/204409600 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2822ffd640 1 --1- 10.20.193.43:0/204409600 >> v1:10.20.193.43:6789/0 conn(0x7f282408d8d0 0x7f282418b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33148/0 (socket says 10.20.193.43:33148) 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 client.?.objecter ms_handle_connect 0x7f282408d8d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 client.?.objecter ms_handle_connect 0x7f282408d4d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178325738 0 0) 0x7f282405e1b0 con 0x7f282408d4d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): my global_id is 74150 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27f4003610 con 0x7f282408d4d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787800005 0 0) 0x7f2824109680 con 0x7f282408d8d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): my global_id is 24573 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f282405e1b0 con 0x7f282408d8d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 client.?.objecter ms_handle_connect 0x7f282408ddb0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2995332547 0 0) 0x7f27f4003610 con 0x7f282408d4d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2824109680 con 0x7f282408d4d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2810003070 con 0x7f282408d4d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): dump: 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4094610667 0 0) 0x7f282405e1b0 con 0x7f282408d8d0 2026-02-21T01:29:48.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27f4003610 con 0x7f282408d8d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2814003400 con 0x7f282408d8d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): dump: 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790617935 0 0) 0x7f2824056fc0 con 0x7f282408ddb0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient(hunting): my global_id is 29005 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f282405e1b0 con 0x7f282408ddb0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 999787270 0 0) 0x7f2824109680 con 0x7f282408d4d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.46:6789/0 conn(0x7f282408ddb0 legacy=0x7f282418ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.43:6789/0 conn(0x7f282408d8d0 legacy=0x7f282418b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 monclient: found mon.c 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2824107320 con 0x7f282408d4d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 5 monclient: authenticate success, global_id 74150 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient: _renew_subs 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28241093a0 con 0x7f282408d4d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 client.74150.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient: _renew_subs 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2824107e80 con 0x7f282408d4d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28100048d0 con 0x7f282408d4d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2829dc3640 1 librados: init done 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2810004c20 con 0x7f282408d4d0 2026-02-21T01:29:48.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f27fffff640 10 monclient: dump: 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.386+0000 7f2821ffb640 4 set_mon_vals no callback set 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f2829dc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f282408a680 con 0x7f28241a10d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 client.74150.objecter ms_handle_connect 0x7f28241a10d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 client.74150.objecter resend_mon_ops 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987124716 0 0) 0x7f27f4003610 con 0x7f28241a10d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient(hunting): my global_id is 74153 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2824109680 con 0x7f28241a10d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f28100115a0 con 0x7f282408d4d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(106..106 src has 1..106) ==== 6805+0+0 (unknown 2767964192 0 0) 0x7f281004e890 con 0x7f282408d4d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 client.74150.objecter ms_dispatch2 0x7f2824000b90 osd_map(106..106 src has 1..106) 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 3 client.74150.objecter handle_osd_map got epochs [106,106] > 0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 3 client.74150.objecter handle_osd_map decoding full epoch 106 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 20 client.74150.objecter dump_active .. 0 homeless 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3268347167 0 0) 0x7f2824109680 con 0x7f28241a10d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27f4003610 con 0x7f28241a10d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2814003c30 con 0x7f28241a10d0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient: dump: 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.394 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1214263165 0 0) 0x7f27f4003610 con 0x7f28241a10d0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f282408edb0 con 0x7f28241a10d0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f2823fff640 10 monclient: get_auth_request con 0x7f27f403eb50 auth_method 0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 client.74150.objecter ms_handle_connect 0x7f27f403eb50 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2814003020 con 0x7f28241a10d0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.43:6790/0 conn(0x7f28241a10d0 legacy=0x7f28241204b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.387+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.43:6790/0 conn(0x7f28241a10d0 legacy=0x7f28241204b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2824054ff0 con 0x7f282414a3c0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 client.74150.objecter ms_handle_connect 0x7f282414a3c0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 client.74150.objecter resend_mon_ops 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454966817 0 0) 0x7f2824054ff0 con 0x7f282414a3c0 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient(hunting): my global_id is 74156 2026-02-21T01:29:48.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27f4003610 con 0x7f282414a3c0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 284045283 0 0) 0x7f27f4003610 con 0x7f282414a3c0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2824054ff0 con 0x7f282414a3c0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2814004030 con 0x7f282414a3c0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient: dump: 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2668701063 0 0) 0x7f2824054ff0 con 0x7f282414a3c0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f282404d140 con 0x7f282414a3c0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4147 (unknown 0 0 154974431) 0x7f28140042b0 con 0x7f282414a3c0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.43:6790/0 conn(0x7f282414a3c0 legacy=0x7f282404ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f27fffff640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.43:6790/0 conn(0x7f282414a3c0 legacy=0x7f282404ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 10, 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 2129, 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:48.396 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:48.397 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.398 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.399 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 10 librados: watch_flush enter 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 10 librados: watch_flush exit 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 20 client.74150.objecter shutdown clearing up homeless session... 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 10 client.74150.objecter successfully canceled tick 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.46:6812/860801619 conn(0x7f27f403eb50 legacy=0x7f27f405f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.400 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 10 monclient: shutdown 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 >> v1:10.20.193.43:6790/0 conn(0x7f282408d4d0 legacy=0x7f282411dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2823fff640 1 -- 10.20.193.43:0/204409600 reap_dead start 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2823fff640 1 -- 10.20.193.43:0/204409600 reap_dead start 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 shutdown_connections 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 >> 10.20.193.43:0/204409600 conn(0x7f282408f480 msgr2=0x7f28240576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 shutdown_connections 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 -- 10.20.193.43:0/204409600 wait complete. 2026-02-21T01:29:48.401 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.391+0000 7f2829dc3640 1 librados: shutdown 2026-02-21T01:29:48.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:29:48.401 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:29:48.401 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:29:48.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.477+0000 7f8b60355640 10 monclient: get_monmap_and_config 2026-02-21T01:29:48.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.477+0000 7f8b60355640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.477+0000 7f8b60355640 10 monclient: monmap: 2026-02-21T01:29:48.478 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.478 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.478 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:48.477974+0000 2026-02-21T01:29:48.478 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:48.477974+0000 2026-02-21T01:29:48.479 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.479 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.479 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.479 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:48.479 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:48.479 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 1 Processor -- start 2026-02-21T01:29:48.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 1 -- start start 2026-02-21T01:29:48.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient: init 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient(hunting): picked mon.noname-b con 0x7f8b58058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient(hunting): picked mon.noname-a con 0x7f8b58057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient(hunting): picked mon.noname-c con 0x7f8b58181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b58056c50 con 0x7f8b58057630 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5808eda0 con 0x7f8b58181e80 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5808f5c0 con 0x7f8b58058260 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient(hunting): authenticate will time out at 720.183418s 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5e0ca640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f8b58058260 0x7f8b5808df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34904/0 (socket says 10.20.193.43:34904) 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d8c9640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f8b58057630 0x7f8b5808e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33156/0 (socket says 10.20.193.43:33156) 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5e0ca640 1 -- 10.20.193.43:0/1286888210 learned_addr learned my addr 10.20.193.43:0/1286888210 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869778114 0 0) 0x7f8b5808f5c0 con 0x7f8b58058260 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): my global_id is 74159 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b40003610 con 0x7f8b58058260 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159994898 0 0) 0x7f8b58056c50 con 0x7f8b58057630 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient(hunting): my global_id is 24576 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b5808f5c0 con 0x7f8b58057630 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 767131817 0 0) 0x7f8b40003610 con 0x7f8b58058260 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 >> v1:10.20.193.46:6789/0 conn(0x7f8b58181e80 legacy=0x7f8b581a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 >> v1:10.20.193.43:6789/0 conn(0x7f8b58057630 legacy=0x7f8b5808e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 monclient: found mon.noname-b 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580563b0 con 0x7f8b58058260 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.487 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8b48002d20 con 0x7f8b58058260 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 5 monclient: authenticate success, global_id 74159 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: dump: 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8b48002ef0 con 0x7f8b58058260 2026-02-21T01:29:48.488 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 1 -- 10.20.193.43:0/1286888210 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8b48003330 con 0x7f8b58058260 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b60355640 4 set_mon_vals no callback set 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.478+0000 7f8b5d0c8640 10 monclient: dump: 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 10 monclient: shutdown 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 -- 10.20.193.43:0/1286888210 >> v1:10.20.193.43:6790/0 conn(0x7f8b58058260 legacy=0x7f8b5808df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.489 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 -- 10.20.193.43:0/1286888210 shutdown_connections 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 -- 10.20.193.43:0/1286888210 >> 10.20.193.43:0/1286888210 conn(0x7f8b58090360 msgr2=0x7f8b58090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 -- 10.20.193.43:0/1286888210 shutdown_connections 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 -- 10.20.193.43:0/1286888210 wait complete. 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 10 monclient: monmap: 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 librados: starting msgr at 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 librados: starting objecter 2026-02-21T01:29:48.490 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.479+0000 7f8b60355640 1 Processor -- start 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 -- start start 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 librados: setting wanted keys 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 librados: calling monclient init 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient: init 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient(hunting): picked mon.noname-b con 0x7f8b58057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient(hunting): picked mon.noname-c con 0x7f8b58058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient(hunting): picked mon.noname-a con 0x7f8b58181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b58149880 con 0x7f8b58181e80 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b58130ad0 con 0x7f8b58057630 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5812fc60 con 0x7f8b58058260 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient(hunting): authenticate will time out at 720.185271s 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b5d8c9640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f8b58058260 0x7f8b58170520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34906/0 (socket says 10.20.193.43:34906) 2026-02-21T01:29:48.491 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b5d8c9640 1 -- 10.20.193.43:0/3380176620 learned_addr learned my addr 10.20.193.43:0/3380176620 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 client.?.objecter ms_handle_connect 0x7f8b58058260 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 client.?.objecter ms_handle_connect 0x7f8b58181e80 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019297163 0 0) 0x7f8b5812fc60 con 0x7f8b58058260 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): my global_id is 74162 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b28003610 con 0x7f8b58058260 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868247784 0 0) 0x7f8b58149880 con 0x7f8b58181e80 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): my global_id is 24579 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b5812fc60 con 0x7f8b58181e80 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 client.?.objecter ms_handle_connect 0x7f8b58057630 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 383894765 0 0) 0x7f8b28003610 con 0x7f8b58058260 2026-02-21T01:29:48.492 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b58149880 con 0x7f8b58058260 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8b4c003240 con 0x7f8b58058260 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): dump: 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032300013 0 0) 0x7f8b58130ad0 con 0x7f8b58057630 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.493 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): my global_id is 29011 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b28003610 con 0x7f8b58057630 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1427868190 0 0) 0x7f8b5812fc60 con 0x7f8b58181e80 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b58130ad0 con 0x7f8b58181e80 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8b540032c0 con 0x7f8b58181e80 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient(hunting): dump: 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1574842923 0 0) 0x7f8b58149880 con 0x7f8b58058260 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.46:6789/0 conn(0x7f8b58057630 legacy=0x7f8b58149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.43:6789/0 conn(0x7f8b58181e80 legacy=0x7f8b58171c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.494 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 monclient: found mon.c 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5812e770 con 0x7f8b58058260 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 5 monclient: authenticate success, global_id 74162 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient: _renew_subs 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8b58130230 con 0x7f8b58058260 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8b4c0034f0 con 0x7f8b58058260 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8b4c004d20 con 0x7f8b58058260 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 client.74162.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b3effd640 10 monclient: dump: 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.495 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b5c8c7640 4 set_mon_vals no callback set 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient: _renew_subs 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8b5812f4b0 con 0x7f8b58058260 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 librados: init done 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.480+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8b580008d0 con 0x7f8b5814c0f0 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f8b4c0116a0 con 0x7f8b58058260 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 client.74162.objecter ms_handle_connect 0x7f8b5814c0f0 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 client.74162.objecter resend_mon_ops 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(106..106 src has 1..106) ==== 6805+0+0 (unknown 2767964192 0 0) 0x7f8b4c04ea10 con 0x7f8b58058260 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 client.74162.objecter ms_dispatch2 0x7f8b58000b90 osd_map(106..106 src has 1..106) 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 3 client.74162.objecter handle_osd_map got epochs [106,106] > 0 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 3 client.74162.objecter handle_osd_map decoding full epoch 106 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 20 client.74162.objecter dump_active .. 0 homeless 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3049084870 0 0) 0x7f8b580008d0 con 0x7f8b5814c0f0 2026-02-21T01:29:48.496 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient(hunting): my global_id is 29014 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b58149880 con 0x7f8b5814c0f0 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b5e8cb640 10 monclient: get_auth_request con 0x7f8b2803ebe0 auth_method 0 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 478036475 0 0) 0x7f8b58149880 con 0x7f8b5814c0f0 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b580008d0 con 0x7f8b5814c0f0 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8b48002fc0 con 0x7f8b5814c0f0 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient: dump: 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 client.74162.objecter ms_handle_connect 0x7f8b2803ebe0 2026-02-21T01:29:48.497 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4105052415 0 0) 0x7f8b580008d0 con 0x7f8b5814c0f0 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b5814c4c0 con 0x7f8b5814c0f0 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8b48002fb0 con 0x7f8b5814c0f0 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.481+0000 7f8b3effd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.482+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.46:6789/0 conn(0x7f8b5814c0f0 legacy=0x7f8b580874b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.482+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.46:6789/0 conn(0x7f8b5814c0f0 legacy=0x7f8b580874b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b60355640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:29:48.498 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8b5812e250 con 0x7f8b58087bc0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 client.74162.objecter ms_handle_connect 0x7f8b58087bc0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 client.74162.objecter resend_mon_ops 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333460870 0 0) 0x7f8b5812e250 con 0x7f8b58087bc0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 monclient(hunting): my global_id is 29017 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b580008d0 con 0x7f8b58087bc0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2783641324 0 0) 0x7f8b580008d0 con 0x7f8b58087bc0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b5812e250 con 0x7f8b58087bc0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8b48004c60 con 0x7f8b58087bc0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 10 monclient: dump: 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.499 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 250019441 0 0) 0x7f8b5812e250 con 0x7f8b58087bc0 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.485+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8b58092830 con 0x7f8b58087bc0 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4484 (unknown 0 0 3518657863) 0x7f8b48004c10 con 0x7f8b58087bc0 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b3effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b3effd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.46:6789/0 conn(0x7f8b58087bc0 legacy=0x7f8b58174370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b3effd640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.46:6789/0 conn(0x7f8b58087bc0 legacy=0x7f8b58174370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 10, 2026-02-21T01:29:48.500 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 124079, 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.501 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.502 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:29:48.503 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:29:48.504 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.505 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.506 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "num": 10 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:29:48.507 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:29:48.508 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:29:48.508 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 10 librados: watch_flush enter 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 10 librados: watch_flush exit 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 20 client.74162.objecter shutdown clearing up homeless session... 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 10 client.74162.objecter successfully canceled tick 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.46:6812/860801619 conn(0x7f8b2803ebe0 legacy=0x7f8b2805f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 10 monclient: shutdown 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 >> v1:10.20.193.43:6790/0 conn(0x7f8b58058260 legacy=0x7f8b58170520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b5e8cb640 1 -- 10.20.193.43:0/3380176620 reap_dead start 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b5e8cb640 1 -- 10.20.193.43:0/3380176620 reap_dead start 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 shutdown_connections 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 >> 10.20.193.43:0/3380176620 conn(0x7f8b58090360 msgr2=0x7f8b5808aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 shutdown_connections 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 1 -- 10.20.193.43:0/3380176620 wait complete. 2026-02-21T01:29:48.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.486+0000 7f8b60355640 1 librados: shutdown 2026-02-21T01:29:48.510 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:29:48.510 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-21T01:29:48.510 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-21T01:29:48.510 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-21T01:29:48.510 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-21T01:29:48.510 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-21T01:29:48.510 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:29:48.521 INFO:tasks.ceph.mon.b:Stopped 2026-02-21T01:29:48.522 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-21T01:29:48.522 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:29:48.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.588+0000 7f1617726640 10 monclient: get_monmap_and_config 2026-02-21T01:29:48.595 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.588+0000 7f1617726640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.588+0000 7f1617726640 10 monclient: monmap: 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:48.589216+0000 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:48.589216+0000 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 1 Processor -- start 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 1 -- start start 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient: init 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient(hunting): picked mon.noname-b con 0x7f16100890e0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient(hunting): picked mon.noname-a con 0x7f161008a170 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient(hunting): picked mon.noname-c con 0x7f161008a540 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1610087750 con 0x7f161008a170 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1610087a30 con 0x7f161008a540 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1610086560 con 0x7f16100890e0 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1617726640 10 monclient(hunting): authenticate will time out at 720.294655s 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1615c9c640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7f161008a540 legacy=0x7f161019ef90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1614c9a640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f161008a170 0x7f161017d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33176/0 (socket says 10.20.193.43:33176) 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f1614c9a640 1 -- 10.20.193.43:0/2456194153 learned_addr learned my addr 10.20.193.43:0/2456194153 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f161549b640 1 --1- 10.20.193.43:0/2456194153 >> v1:10.20.193.43:6790/0 conn(0x7f16100890e0 0x7f1610089a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34922/0 (socket says 10.20.193.43:34922) 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654089760 0 0) 0x7f1610087750 con 0x7f161008a170 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f15fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f15fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f15fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f15fffff640 10 monclient(hunting): my global_id is 24582 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.589+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f8003610 con 0x7f161008a170 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3163984015 0 0) 0x7f15f8003610 con 0x7f161008a170 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 >> v1:10.20.193.43:6790/0 conn(0x7f16100890e0 legacy=0x7f1610089a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 >> v1:10.20.193.46:6789/0 conn(0x7f161008a540 legacy=0x7f161019ef90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 monclient: found mon.noname-a 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161008af90 con 0x7f161008a170 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1604002df0 con 0x7f161008a170 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: dump: 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 5 monclient: authenticate success, global_id 24582 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1604003080 con 0x7f161008a170 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 1 -- 10.20.193.43:0/2456194153 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f16040034c0 con 0x7f161008a170 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f15fffff640 10 monclient: dump: 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 4 set_mon_vals no callback set 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 10 monclient: shutdown 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 -- 10.20.193.43:0/2456194153 >> v1:10.20.193.43:6789/0 conn(0x7f161008a170 legacy=0x7f161017d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 -- 10.20.193.43:0/2456194153 shutdown_connections 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 -- 10.20.193.43:0/2456194153 >> 10.20.193.43:0/2456194153 conn(0x7f161008f480 msgr2=0x7f161008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 -- 10.20.193.43:0/2456194153 shutdown_connections 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 -- 10.20.193.43:0/2456194153 wait complete. 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 10 monclient: build_initial_monmap 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 10 monclient: monmap: 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 librados: starting msgr at 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 librados: starting objecter 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 Processor -- start 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 -- start start 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 librados: setting wanted keys 2026-02-21T01:29:48.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 1 librados: calling monclient init 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.590+0000 7f1617726640 10 monclient: init 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient(hunting): picked mon.noname-b con 0x7f16100890e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient(hunting): picked mon.noname-a con 0x7f161008a170 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient(hunting): picked mon.noname-c con 0x7f161008a540 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161018ef90 con 0x7f161008a170 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16101a4c30 con 0x7f16100890e0 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16101ab4b0 con 0x7f161008a540 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient(hunting): authenticate will time out at 720.296269s 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f161549b640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7f16100890e0 legacy=0x7f16101a3e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1614c9a640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f161008a170 0x7f1610217440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33182/0 (socket says 10.20.193.43:33182) 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1614c9a640 1 -- 10.20.193.43:0/1707396650 learned_addr learned my addr 10.20.193.43:0/1707396650 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1615c9c640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f161008a540 0x7f1610238b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:34928/0 (socket says 10.20.193.43:34928) 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 client.?.objecter ms_handle_connect 0x7f161008a170 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 client.?.objecter ms_handle_connect 0x7f161008a540 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:48.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466161728 0 0) 0x7f161008af90 con 0x7f161008a170 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): _negotiate 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): my global_id is 24585 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e0003610 con 0x7f161008a170 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3644871124 0 0) 0x7f15e0003610 con 0x7f161008a170 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f161008af90 con 0x7f161008a170 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f16040033d0 con 0x7f161008a170 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): dump: 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.603 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2348742044 0 0) 0x7f161008af90 con 0x7f161008a170 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 >> v1:10.20.193.43:6790/0 conn(0x7f161008a540 legacy=0x7f1610238b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 >> v1:10.20.193.46:6789/0 conn(0x7f16100890e0 legacy=0x7f16101a3e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: _finish_hunting 0 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 monclient: found mon.a 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161018f830 con 0x7f161008a170 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: _finish_auth 0 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: _check_auth_tickets 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 5 monclient: authenticate success, global_id 24585 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient: _renew_subs 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16101a4580 con 0x7f161008a170 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 client.24585.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient: _renew_subs 2026-02-21T01:29:48.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f161018e210 con 0x7f161008a170 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f1617726640 1 librados: init done 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1604003030 con 0x7f161008a170 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1604004f40 con 0x7f161008a170 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15fdffb640 10 monclient: dump: 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:48.605 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.591+0000 7f15ff7fe640 4 set_mon_vals no callback set 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f1617726640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f1617726640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f1617726640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f161005e190 con 0x7f161008a170 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f16040118c0 con 0x7f161008a170 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(106..106 src has 1..106) ==== 6805+0+0 (unknown 2767964192 0 0) 0x7f160404eb40 con 0x7f161008a170 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f15fdffb640 10 client.24585.objecter ms_dispatch2 0x7f1610000b90 osd_map(106..106 src has 1..106) 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f15fdffb640 3 client.24585.objecter handle_osd_map got epochs [106,106] > 0 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f15fdffb640 3 client.24585.objecter handle_osd_map decoding full epoch 106 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f15fdffb640 20 client.24585.objecter dump_active .. 0 homeless 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f161549b640 10 monclient: get_auth_request con 0x7f15e003e790 auth_method 0 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.592+0000 7f15fdffb640 10 client.24585.objecter ms_handle_connect 0x7f15e003e790 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.594+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f161018ef90 con 0x7f161008a170 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.594+0000 7f15fdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:48.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.594+0000 7f15fdffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.746+0000 7f1617726640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.746+0000 7f1617726640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.746+0000 7f1617726640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.746+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1610054ff0 con 0x7f161008a170 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.746+0000 7f15fdffb640 1 -- 10.20.193.43:0/1707396650 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 3134868861) 0x7f16040178a0 con 0x7f161008a170 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.746+0000 7f15fdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.746+0000 7f15fdffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:48.747 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 10 librados: watch_flush enter 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 10 librados: watch_flush exit 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 20 client.24585.objecter shutdown clearing up homeless session... 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 10 client.24585.objecter successfully canceled tick 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 >> v1:10.20.193.46:6812/860801619 conn(0x7f15e003e790 legacy=0x7f15e005ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 10 monclient: shutdown 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 >> v1:10.20.193.43:6789/0 conn(0x7f161008a170 legacy=0x7f1610217440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 shutdown_connections 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 >> 10.20.193.43:0/1707396650 conn(0x7f161008f480 msgr2=0x7f161005be90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 shutdown_connections 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 1 -- 10.20.193.43:0/1707396650 wait complete. 2026-02-21T01:29:48.748 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:48.747+0000 7f1617726640 1 librados: shutdown 2026-02-21T01:29:51.756 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:29:51.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.823+0000 7f6e87fe0640 10 monclient: get_monmap_and_config 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.823+0000 7f6e87fe0640 10 monclient: build_initial_monmap 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.823+0000 7f6e87fe0640 10 monclient: monmap: 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:51.825178+0000 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:51.825178+0000 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:51.833 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 1 Processor -- start 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 1 -- start start 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient: init 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient(hunting): picked mon.noname-a con 0x7f6e8008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient(hunting): picked mon.noname-b con 0x7f6e8008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient(hunting): picked mon.noname-c con 0x7f6e8008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:51.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8008a690 con 0x7f6e8008ddb0 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8008b910 con 0x7f6e8008d8d0 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e80088ae0 con 0x7f6e8008d4d0 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e87fe0640 10 monclient(hunting): authenticate will time out at 723.530628s 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e86556640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7f6e8008d8d0 legacy=0x7f6e8019f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e85d55640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6e8008ddb0 0x7f6e8008e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53490/0 (socket says 10.20.193.43:53490) 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e85d55640 1 -- 10.20.193.43:0/4283292675 learned_addr learned my addr 10.20.193.43:0/4283292675 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e85554640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f6e8008d4d0 0x7f6e8017e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:47948/0 (socket says 10.20.193.43:47948) 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4173026025 0 0) 0x7f6e8008a690 con 0x7f6e8008ddb0 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e84d53640 10 monclient(hunting): _negotiate 2026-02-21T01:29:51.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e84d53640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e84d53640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e84d53640 10 monclient(hunting): my global_id is 24588 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.824+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e68003610 con 0x7f6e8008ddb0 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3415182658 0 0) 0x7f6e68003610 con 0x7f6e8008ddb0 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 >> v1:10.20.193.43:6790/0 conn(0x7f6e8008d4d0 legacy=0x7f6e8017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 >> v1:10.20.193.46:6789/0 conn(0x7f6e8008d8d0 legacy=0x7f6e8019f7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: _finish_hunting 0 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 monclient: found mon.noname-a 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e801a3ef0 con 0x7f6e8008ddb0 2026-02-21T01:29:51.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: _finish_auth 0 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: _check_auth_tickets 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6e70002df0 con 0x7f6e8008ddb0 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 5 monclient: authenticate success, global_id 24588 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: dump: 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:51.837 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e700030f0 con 0x7f6e8008ddb0 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 1 -- 10.20.193.43:0/4283292675 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6e70003530 con 0x7f6e8008ddb0 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 10 monclient: get_monmap_and_config success 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 4 set_mon_vals no callback set 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e84d53640 10 monclient: dump: 2026-02-21T01:29:51.838 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 10 monclient: shutdown 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 -- 10.20.193.43:0/4283292675 >> v1:10.20.193.43:6789/0 conn(0x7f6e8008ddb0 legacy=0x7f6e8008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:51.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 -- 10.20.193.43:0/4283292675 shutdown_connections 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 -- 10.20.193.43:0/4283292675 >> 10.20.193.43:0/4283292675 conn(0x7f6e8008f480 msgr2=0x7f6e8008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 -- 10.20.193.43:0/4283292675 shutdown_connections 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 -- 10.20.193.43:0/4283292675 wait complete. 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 10 monclient: build_initial_monmap 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 10 monclient: monmap: 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:51.840 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 librados: starting msgr at 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 librados: starting objecter 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.825+0000 7f6e87fe0640 1 Processor -- start 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 -- start start 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 librados: setting wanted keys 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 librados: calling monclient init 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient: init 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient(hunting): picked mon.noname-b con 0x7f6e8008d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient(hunting): picked mon.noname-a con 0x7f6e8008d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:51.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient(hunting): picked mon.noname-c con 0x7f6e8008ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e80124d00 con 0x7f6e8008d8d0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8013a560 con 0x7f6e8008d4d0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e801267c0 con 0x7f6e8008ddb0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient(hunting): authenticate will time out at 723.532234s 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e85554640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6e8008d8d0 0x7f6e8011e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53494/0 (socket says 10.20.193.43:53494) 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e85554640 1 -- 10.20.193.43:0/3182967572 learned_addr learned my addr 10.20.193.43:0/3182967572 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e85d55640 1 -- 10.20.193.43:0/3182967572 >> v1:10.20.193.46:6789/0 conn(0x7f6e8008d4d0 legacy=0x7f6e8011da40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 client.?.objecter ms_handle_connect 0x7f6e8008d8d0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 client.?.objecter ms_handle_connect 0x7f6e8008ddb0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776510164 0 0) 0x7f6e80124d00 con 0x7f6e8008d8d0 2026-02-21T01:29:51.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): my global_id is 24591 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e50003610 con 0x7f6e8008d8d0 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 198685046 0 0) 0x7f6e50003610 con 0x7f6e8008d8d0 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e80124d00 con 0x7f6e8008d8d0 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6e74003090 con 0x7f6e8008d8d0 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): dump: 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.843 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3628411916 0 0) 0x7f6e80124d00 con 0x7f6e8008d8d0 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 >> v1:10.20.193.43:6790/0 conn(0x7f6e8008ddb0 legacy=0x7f6e8019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 >> v1:10.20.193.46:6789/0 conn(0x7f6e8008d4d0 legacy=0x7f6e8011da40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 monclient: found mon.a 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e80126aa0 con 0x7f6e8008d8d0 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: _finish_auth 0 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:29:51.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 5 monclient: authenticate success, global_id 24591 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient: _renew_subs 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e80125860 con 0x7f6e8008d8d0 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 client.24591.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient: _renew_subs 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e801244d0 con 0x7f6e8008d8d0 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e87fe0640 1 librados: init done 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e740034c0 con 0x7f6e8008d8d0 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6e74004d60 con 0x7f6e8008d8d0 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6e7fc640 10 monclient: dump: 2026-02-21T01:29:51.845 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.826+0000 7f6e6ffff640 4 set_mon_vals no callback set 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f6e74004f00 con 0x7f6e8008d8d0 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e87fe0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e87fe0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e87fe0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8008edd0 con 0x7f6e8008d8d0 2026-02-21T01:29:51.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(106..106 src has 1..106) ==== 6805+0+0 (unknown 2767964192 0 0) 0x7f6e7404eb10 con 0x7f6e8008d8d0 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e6e7fc640 10 client.24591.objecter ms_dispatch2 0x7f6e80000b90 osd_map(106..106 src has 1..106) 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e6e7fc640 3 client.24591.objecter handle_osd_map got epochs [106,106] > 0 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e6e7fc640 3 client.24591.objecter handle_osd_map decoding full epoch 106 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e6e7fc640 20 client.24591.objecter dump_active .. 0 homeless 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e85d55640 10 monclient: get_auth_request con 0x7f6e5003e800 auth_method 0 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.827+0000 7f6e6e7fc640 10 client.24591.objecter ms_handle_connect 0x7f6e5003e800 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.829+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6e74017810 con 0x7f6e8008d8d0 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.829+0000 7f6e6e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:29:51.847 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.829+0000 7f6e6e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.979+0000 7f6e87fe0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.979+0000 7f6e87fe0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.979+0000 7f6e87fe0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.979+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6e80057ed0 con 0x7f6e8008d8d0 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.979+0000 7f6e6e7fc640 1 -- 10.20.193.43:0/3182967572 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 3935363121) 0x7f6e74017110 con 0x7f6e8008d8d0 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.979+0000 7f6e6e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.979+0000 7f6e6e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:29:51.981 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.980+0000 7f6e87fe0640 10 librados: watch_flush enter 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.980+0000 7f6e87fe0640 10 librados: watch_flush exit 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.980+0000 7f6e87fe0640 20 client.24591.objecter shutdown clearing up homeless session... 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.980+0000 7f6e87fe0640 10 client.24591.objecter successfully canceled tick 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 >> v1:10.20.193.46:6812/860801619 conn(0x7f6e5003e800 legacy=0x7f6e5005ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 10 monclient: shutdown 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 >> v1:10.20.193.43:6789/0 conn(0x7f6e8008d8d0 legacy=0x7f6e8011e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 shutdown_connections 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 >> 10.20.193.43:0/3182967572 conn(0x7f6e8008f480 msgr2=0x7f6e801a2740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 shutdown_connections 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 1 -- 10.20.193.43:0/3182967572 wait complete. 2026-02-21T01:29:51.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:51.981+0000 7f6e87fe0640 1 librados: shutdown 2026-02-21T01:29:54.990 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:29:55.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient: get_monmap_and_config 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient: build_initial_monmap 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient: monmap: 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:29:55.059508+0000 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:29:55.059508+0000 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:29:55.061 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 1 Processor -- start 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 1 -- start start 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient: init 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient: _reopen_session rank -1 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient(hunting): picked mon.noname-a con 0x7fa56808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient(hunting): picked mon.noname-b con 0x7fa56808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient(hunting): picked mon.noname-c con 0x7fa56808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56808a690 con 0x7fa56808ddb0 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56808b910 con 0x7fa56808d8d0 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa568088ae0 con 0x7fa56808d4d0 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56e7a2640 10 monclient(hunting): authenticate will time out at 726.764919s 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa567fff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fa56808ddb0 0x7fa56808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53506/0 (socket says 10.20.193.43:53506) 2026-02-21T01:29:55.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa567fff640 1 -- 10.20.193.43:0/236921950 learned_addr learned my addr 10.20.193.43:0/236921950 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:29:55.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.058+0000 7fa56cd18640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa56819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:55.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.260+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa56819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:55.663 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:55.661+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa56819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:56.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:56.463+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa56819f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient(hunting): tick 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 1 monclient(hunting): continuing hunt 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.43:6790/0 conn(0x7fa56808d4d0 legacy=0x7fa56817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa56819f7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.43:6789/0 conn(0x7fa56808ddb0 legacy=0x7fa56808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:29:58.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fa56808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fa56808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fa56808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5681a3ef0 con 0x7fa56808ddb0 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56808b910 con 0x7fa56808d8d0 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa544069fb0 con 0x7fa56808d4d0 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa565ffb640 10 monclient(hunting): _renew_subs 2026-02-21T01:29:58.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.059+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:58.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.260+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:58.663 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:58.662+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:29:59.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:29:59.464+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:01.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient(hunting): tick 2026-02-21T01:30:01.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:30:01.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 1 monclient(hunting): continuing hunt 2026-02-21T01:30:01.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:30:01.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.43:6790/0 conn(0x7fa56808d4d0 legacy=0x7fa5440237e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:01.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.43:6789/0 conn(0x7fa56808ddb0 legacy=0x7fa544044f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fa56808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fa56808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fa56808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54406b250 con 0x7fa56808ddb0 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56808b910 con 0x7fa56808d8d0 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa544069010 con 0x7fa56808d4d0 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa565ffb640 10 monclient(hunting): _renew_subs 2026-02-21T01:30:01.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.059+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:01.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.260+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:01.663 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:01.662+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:02.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.463+0000 7fa56cd18640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:02.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.537+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252031902 0 0) 0x7fa54406b250 con 0x7fa56808ddb0 2026-02-21T01:30:02.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.537+0000 7fa566ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.537+0000 7fa566ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.537+0000 7fa566ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.537+0000 7fa566ffd640 10 monclient(hunting): my global_id is 24594 2026-02-21T01:30:02.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.537+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54c003610 con 0x7fa56808ddb0 2026-02-21T01:30:02.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329146119 0 0) 0x7fa544069010 con 0x7fa56808d4d0 2026-02-21T01:30:02.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 10 monclient(hunting): my global_id is 74165 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54406b250 con 0x7fa56808d4d0 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4008518074 0 0) 0x7fa54c003610 con 0x7fa56808ddb0 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.43:6790/0 conn(0x7fa56808d4d0 legacy=0x7fa54406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.46:6789/0 conn(0x7fa56808d8d0 legacy=0x7fa544066790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 1 monclient: found mon.noname-a 2026-02-21T01:30:02.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.538+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa544069280 con 0x7fa56808ddb0 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: _finish_auth 0 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa558002d40 con 0x7fa56808ddb0 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: dump: 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.550 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 5 monclient: authenticate success, global_id 24594 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa558002f80 con 0x7fa56808ddb0 2026-02-21T01:30:02.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 1 -- 10.20.193.43:0/236921950 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa5580033c0 con 0x7fa56808ddb0 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa566ffd640 10 monclient: dump: 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.552 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.553 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.553 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.553 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.553 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 10 monclient: get_monmap_and_config success 2026-02-21T01:30:02.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 4 set_mon_vals no callback set 2026-02-21T01:30:02.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 10 monclient: shutdown 2026-02-21T01:30:02.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:30:02.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 1 -- 10.20.193.43:0/236921950 >> v1:10.20.193.43:6789/0 conn(0x7fa56808ddb0 legacy=0x7fa54406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 1 -- 10.20.193.43:0/236921950 shutdown_connections 2026-02-21T01:30:02.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.539+0000 7fa56e7a2640 1 -- 10.20.193.43:0/236921950 >> 10.20.193.43:0/236921950 conn(0x7fa56808f480 msgr2=0x7fa56808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:30:02.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.540+0000 7fa56e7a2640 1 -- 10.20.193.43:0/236921950 shutdown_connections 2026-02-21T01:30:02.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.540+0000 7fa56e7a2640 1 -- 10.20.193.43:0/236921950 wait complete. 2026-02-21T01:30:02.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient: build_initial_monmap 2026-02-21T01:30:02.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient: monmap: 2026-02-21T01:30:02.555 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:30:02.555 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:30:02.555 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 1 librados: starting msgr at 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 1 librados: starting objecter 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 1 Processor -- start 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 1 -- start start 2026-02-21T01:30:02.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 1 librados: setting wanted keys 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 1 librados: calling monclient init 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient: init 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient: _reopen_session rank -1 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient(hunting): picked mon.noname-a con 0x7fa56808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient(hunting): picked mon.noname-c con 0x7fa56808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.541+0000 7fa56e7a2640 10 monclient(hunting): picked mon.noname-b con 0x7fa56808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa568127080 con 0x7fa56808d4d0 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa568128c90 con 0x7fa56808ddb0 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa568128f70 con 0x7fa56808d8d0 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 10 monclient(hunting): _renew_subs 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 10 monclient(hunting): authenticate will time out at 734.248020s 2026-02-21T01:30:02.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56cd18640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7fa56808ddb0 legacy=0x7fa568191f90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa5677fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fa56808d8d0 0x7fa568190870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:47606/0 (socket says 10.20.193.43:47606) 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa5677fe640 1 -- 10.20.193.43:0/3311326084 learned_addr learned my addr 10.20.193.43:0/3311326084 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 client.?.objecter ms_handle_connect 0x7fa56808d4d0 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 client.?.objecter ms_handle_connect 0x7fa56808d8d0 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489094957 0 0) 0x7fa568128f70 con 0x7fa56808d8d0 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): my global_id is 74168 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa538003610 con 0x7fa56808d8d0 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594573769 0 0) 0x7fa54406b250 con 0x7fa56808d4d0 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): my global_id is 24597 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa568128f70 con 0x7fa56808d4d0 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 974395631 0 0) 0x7fa538003610 con 0x7fa56808d8d0 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa54406b250 con 0x7fa56808d8d0 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa5580032d0 con 0x7fa56808d8d0 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:30:02.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): dump: 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.560 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 42692308 0 0) 0x7fa54406b250 con 0x7fa56808d8d0 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 >> v1:10.20.193.46:6789/0 conn(0x7fa56808ddb0 legacy=0x7fa568191f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 >> v1:10.20.193.43:6789/0 conn(0x7fa56808d4d0 legacy=0x7fa568139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 monclient: found mon.c 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56813b450 con 0x7fa56808d8d0 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: _finish_auth 0 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:30:02.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 5 monclient: authenticate success, global_id 74168 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 10 monclient: _renew_subs 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa56813db10 con 0x7fa56808d8d0 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 10 client.74168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 10 monclient: _renew_subs 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5681289b0 con 0x7fa56808d8d0 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa56e7a2640 1 librados: init done 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5580039b0 con 0x7fa56808d8d0 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa558003dc0 con 0x7fa56808d8d0 2026-02-21T01:30:02.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa564ff9640 10 monclient: dump: 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.563 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.542+0000 7fa5667fc640 4 set_mon_vals no callback set 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fa558003f60 con 0x7fa56808d8d0 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa56e7a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa56e7a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa56e7a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56808edd0 con 0x7fa56808d8d0 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(107..107 src has 1..107) ==== 6423+0+0 (unknown 394907342 0 0) 0x7fa55804e7b0 con 0x7fa56808d8d0 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa564ff9640 10 client.74168.objecter ms_dispatch2 0x7fa568000b90 osd_map(107..107 src has 1..107) 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa564ff9640 3 client.74168.objecter handle_osd_map got epochs [107,107] > 0 2026-02-21T01:30:02.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.543+0000 7fa564ff9640 3 client.74168.objecter handle_osd_map decoding full epoch 107 2026-02-21T01:30:02.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.544+0000 7fa564ff9640 20 client.74168.objecter dump_active .. 0 homeless 2026-02-21T01:30:02.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.544+0000 7fa567fff640 10 monclient: get_auth_request con 0x7fa53803e9a0 auth_method 0 2026-02-21T01:30:02.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.544+0000 7fa564ff9640 10 client.74168.objecter ms_handle_connect 0x7fa53803e9a0 2026-02-21T01:30:02.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.547+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa5580176f0 con 0x7fa56808d8d0 2026-02-21T01:30:02.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.547+0000 7fa564ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:30:02.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.547+0000 7fa564ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:30:02.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.702+0000 7fa56e7a2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:30:02.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.702+0000 7fa56e7a2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:30:02.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.702+0000 7fa56e7a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.702+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa568054ff0 con 0x7fa56808d8d0 2026-02-21T01:30:02.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.702+0000 7fa564ff9640 1 -- 10.20.193.43:0/3311326084 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1460 (unknown 254746657 0 1202285715) 0x7fa558016ff0 con 0x7fa56808d8d0 2026-02-21T01:30:02.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.702+0000 7fa564ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:30:02.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.702+0000 7fa564ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:30:02.706 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":14,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:30:02.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 10 librados: watch_flush enter 2026-02-21T01:30:02.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 10 librados: watch_flush exit 2026-02-21T01:30:02.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 20 client.74168.objecter shutdown clearing up homeless session... 2026-02-21T01:30:02.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 10 client.74168.objecter successfully canceled tick 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 >> v1:10.20.193.46:6812/860801619 conn(0x7fa53803e9a0 legacy=0x7fa53805ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 10 monclient: shutdown 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 >> v1:10.20.193.43:6790/0 conn(0x7fa56808d8d0 legacy=0x7fa568190870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 shutdown_connections 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 >> 10.20.193.43:0/3311326084 conn(0x7fa56808f480 msgr2=0x7fa56805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 shutdown_connections 2026-02-21T01:30:02.708 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 1 -- 10.20.193.43:0/3311326084 wait complete. 2026-02-21T01:30:02.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.704+0000 7fa56e7a2640 1 librados: shutdown 2026-02-21T01:30:02.715 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-21T01:30:02.715 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-21T01:30:02.715 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:30:02.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.784+0000 7f49171b1640 10 monclient: get_monmap_and_config 2026-02-21T01:30:02.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.784+0000 7f49171b1640 10 monclient: build_initial_monmap 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.784+0000 7f49171b1640 10 monclient: monmap: 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:30:02.786055+0000 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:30:02.786055+0000 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 1 Processor -- start 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 1 -- start start 2026-02-21T01:30:02.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient: init 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient: _reopen_session rank -1 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient(hunting): picked mon.noname-c con 0x7f491008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient(hunting): picked mon.noname-b con 0x7f491008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient(hunting): picked mon.noname-a con 0x7f491008d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491008a690 con 0x7f491008d8d0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491008b910 con 0x7f491008ddb0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4910088ae0 con 0x7f491008d4d0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient(hunting): _renew_subs 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient(hunting): authenticate will time out at 734.491508s 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f4914f26640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7f491008ddb0 legacy=0x7f491008e180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f4907fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f491008d4d0 0x7f491017e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:47612/0 (socket says 10.20.193.43:47612) 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f4907fff640 1 -- 10.20.193.43:0/967577630 learned_addr learned my addr 10.20.193.43:0/967577630 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313308465 0 0) 0x7f4910088ae0 con 0x7f491008d4d0 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): my global_id is 74177 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48fc003610 con 0x7f491008d4d0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655163030 0 0) 0x7f491008a690 con 0x7f491008d8d0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient(hunting): my global_id is 24606 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4910088ae0 con 0x7f491008d8d0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1162678134 0 0) 0x7f48fc003610 con 0x7f491008d4d0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 >> v1:10.20.193.46:6789/0 conn(0x7f491008ddb0 legacy=0x7f491008e180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 >> v1:10.20.193.43:6789/0 conn(0x7f491008d8d0 legacy=0x7f491019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: _finish_hunting 0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 monclient: found mon.noname-b 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49101a3ef0 con 0x7f491008d4d0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: _finish_auth 0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: _check_auth_tickets 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48f8002df0 con 0x7f491008d4d0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: dump: 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 5 monclient: authenticate success, global_id 74177 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48f80030f0 con 0x7f491008d4d0 2026-02-21T01:30:02.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 1 -- 10.20.193.43:0/967577630 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48f8003530 con 0x7f491008d4d0 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49077fe640 10 monclient: dump: 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 10 monclient: get_monmap_and_config success 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.785+0000 7f49171b1640 4 set_mon_vals no callback set 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 10 monclient: shutdown 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 -- 10.20.193.43:0/967577630 >> v1:10.20.193.43:6790/0 conn(0x7f491008d4d0 legacy=0x7f491017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 -- 10.20.193.43:0/967577630 shutdown_connections 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 -- 10.20.193.43:0/967577630 >> 10.20.193.43:0/967577630 conn(0x7f491008f480 msgr2=0x7f491008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 -- 10.20.193.43:0/967577630 shutdown_connections 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 -- 10.20.193.43:0/967577630 wait complete. 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 10 monclient: build_initial_monmap 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 10 monclient: monmap: 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 librados: starting msgr at 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 librados: starting objecter 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 Processor -- start 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 -- start start 2026-02-21T01:30:02.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 librados: setting wanted keys 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 1 librados: calling monclient init 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.786+0000 7f49171b1640 10 monclient: init 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient: _reopen_session rank -1 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient(hunting): picked mon.noname-b con 0x7f491008d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient(hunting): picked mon.noname-c con 0x7f491008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient(hunting): picked mon.noname-a con 0x7f491008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491010cd20 con 0x7f491008ddb0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491010d000 con 0x7f491008d4d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4910057380 con 0x7f491008d8d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient(hunting): _renew_subs 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient(hunting): authenticate will time out at 734.493151s 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f4907fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f491008d8d0 0x7f491018dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:47624/0 (socket says 10.20.193.43:47624) 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f4907fff640 1 -- 10.20.193.43:0/2762484606 learned_addr learned my addr 10.20.193.43:0/2762484606 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f4914f26640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7f491008d4d0 legacy=0x7f491011d270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 client.?.objecter ms_handle_connect 0x7f491008d8d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 client.?.objecter ms_handle_connect 0x7f491008ddb0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935452867 0 0) 0x7f4910057380 con 0x7f491008d8d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): my global_id is 74180 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e0003610 con 0x7f491008d8d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062702182 0 0) 0x7f491010cd20 con 0x7f491008ddb0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): my global_id is 24609 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4910057380 con 0x7f491008ddb0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3231915151 0 0) 0x7f48e0003610 con 0x7f491008d8d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f491010cd20 con 0x7f491008d8d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48f8002db0 con 0x7f491008d8d0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): dump: 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.797 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2129503607 0 0) 0x7f491010cd20 con 0x7f491008d8d0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.46:6789/0 conn(0x7f491008d4d0 legacy=0x7f491011d270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.43:6789/0 conn(0x7f491008ddb0 legacy=0x7f491018f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: _finish_hunting 0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 monclient: found mon.c 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4910056fc0 con 0x7f491008d8d0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: _finish_auth 0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: _check_auth_tickets 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 5 monclient: authenticate success, global_id 74180 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient: _renew_subs 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f491005e190 con 0x7f491008d8d0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 client.74180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient: _renew_subs 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f491010b550 con 0x7f491008d8d0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 1 librados: init done 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48f8004d90 con 0x7f491008d8d0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48f80050e0 con 0x7f491008d8d0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 monclient: dump: 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.798 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f4906ffd640 4 set_mon_vals no callback set 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4910089960 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 client.74180.objecter ms_handle_connect 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 10 client.74180.objecter resend_mon_ops 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.787+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f48f8011a60 con 0x7f491008d8d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(107..107 src has 1..107) ==== 6423+0+0 (unknown 394907342 0 0) 0x7f48f804e8c0 con 0x7f491008d8d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 client.74180.objecter ms_dispatch2 0x7f4910000b90 osd_map(107..107 src has 1..107) 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 3 client.74180.objecter handle_osd_map got epochs [107,107] > 0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 3 client.74180.objecter handle_osd_map decoding full epoch 107 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 20 client.74180.objecter dump_active .. 0 homeless 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766667797 0 0) 0x7f4900003bd0 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient(hunting): my global_id is 24612 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f491010cd20 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f4915727640 10 monclient: get_auth_request con 0x7f48e003e890 auth_method 0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3258988036 0 0) 0x7f491010cd20 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4900003bd0 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4900004220 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient: dump: 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1331503717 0 0) 0x7f4900003bd0 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4910057c70 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 client.74180.objecter ms_handle_connect 0x7f48e003e890 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4900006690 con 0x7f49101a10d0 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:30:02.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.43:6789/0 conn(0x7f49101a10d0 legacy=0x7f49100595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.788+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.43:6789/0 conn(0x7f49101a10d0 legacy=0x7f49100595b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.791+0000 7f49171b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f491008edb0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 client.74180.objecter ms_handle_connect 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 client.74180.objecter resend_mon_ops 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782170128 0 0) 0x7f491008edb0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient(hunting): my global_id is 24615 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4900003bd0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3229927087 0 0) 0x7f4900003bd0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f491008edb0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f49000049b0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient: dump: 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 537778898 0 0) 0x7f491008edb0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4910054ff0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4307 (unknown 0 0 828058464) 0x7f49000068e0 con 0x7f49100876c0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.43:6789/0 conn(0x7f49100876c0 legacy=0x7f491004ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49057fa640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.43:6789/0 conn(0x7f49100876c0 legacy=0x7f491004ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:30:02.800 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 14, 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 138423, 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:30:02.801 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:30:02.802 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:30:02.803 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "num": 4 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "num": 7 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:30:02.804 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 10 librados: watch_flush enter 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 10 librados: watch_flush exit 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 20 client.74180.objecter shutdown clearing up homeless session... 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 10 client.74180.objecter successfully canceled tick 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.46:6812/860801619 conn(0x7f48e003e890 legacy=0x7f48e005ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 10 monclient: shutdown 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 >> v1:10.20.193.43:6790/0 conn(0x7f491008d8d0 legacy=0x7f491018dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f4915727640 1 -- 10.20.193.43:0/2762484606 reap_dead start 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f4915727640 1 -- 10.20.193.43:0/2762484606 reap_dead start 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 shutdown_connections 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 >> 10.20.193.43:0/2762484606 conn(0x7f491008f480 msgr2=0x7f491011f210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 shutdown_connections 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 -- 10.20.193.43:0/2762484606 wait complete. 2026-02-21T01:30:02.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.792+0000 7f49171b1640 1 librados: shutdown 2026-02-21T01:30:02.805 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:30:02.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-21T01:30:02.806 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient: get_monmap_and_config 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient: build_initial_monmap 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient: monmap: 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:30:02.874591+0000 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:30:02.874591+0000 2026-02-21T01:30:02.880 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 1 Processor -- start 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 1 -- start start 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient: init 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient: _reopen_session rank -1 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient(hunting): picked mon.noname-a con 0x7f275408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient(hunting): picked mon.noname-b con 0x7f275408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient(hunting): picked mon.noname-c con 0x7f275408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275408a690 con 0x7f275408ddb0 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275408b910 con 0x7f275408d8d0 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2754088ae0 con 0x7f275408d4d0 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient(hunting): _renew_subs 2026-02-21T01:30:02.881 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.873+0000 7f275a493640 10 monclient(hunting): authenticate will time out at 734.579993s 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2758a09640 1 -- >> v1:10.20.193.46:6789/0 conn(0x7f275408d8d0 legacy=0x7f275419f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2753fff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f275408ddb0 0x7f275408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:47474/0 (socket says 10.20.193.43:47474) 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f27537fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f275408d4d0 0x7f275417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:47628/0 (socket says 10.20.193.43:47628) 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2753fff640 1 -- 10.20.193.43:0/649371167 learned_addr learned my addr 10.20.193.43:0/649371167 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236902337 0 0) 0x7f2754088ae0 con 0x7f275408d4d0 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): my global_id is 74183 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2738003610 con 0x7f275408d4d0 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776174275 0 0) 0x7f275408a690 con 0x7f275408ddb0 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient(hunting): my global_id is 24618 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2754088ae0 con 0x7f275408ddb0 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1360010491 0 0) 0x7f2738003610 con 0x7f275408d4d0 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 >> v1:10.20.193.46:6789/0 conn(0x7f275408d8d0 legacy=0x7f275419f7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:30:02.882 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 >> v1:10.20.193.43:6789/0 conn(0x7f275408ddb0 legacy=0x7f275408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 monclient: found mon.noname-b 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27541a3ef0 con 0x7f275408d4d0 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: _finish_auth 0 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2744002df0 con 0x7f275408d4d0 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 5 monclient: authenticate success, global_id 74183 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: dump: 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.883 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27440030b0 con 0x7f275408d4d0 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 1 -- 10.20.193.43:0/649371167 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f27440034f0 con 0x7f275408d4d0 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f2752ffd640 10 monclient: dump: 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.884 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 10 monclient: get_monmap_and_config success 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 4 set_mon_vals no callback set 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 10 monclient: shutdown 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 1 -- 10.20.193.43:0/649371167 >> v1:10.20.193.43:6790/0 conn(0x7f275408d4d0 legacy=0x7f275417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 1 -- 10.20.193.43:0/649371167 shutdown_connections 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 1 -- 10.20.193.43:0/649371167 >> 10.20.193.43:0/649371167 conn(0x7f275408f480 msgr2=0x7f275408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 1 -- 10.20.193.43:0/649371167 shutdown_connections 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.874+0000 7f275a493640 1 -- 10.20.193.43:0/649371167 wait complete. 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: build_initial_monmap 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: monmap: 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:30:02.885 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 librados: starting msgr at 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 librados: starting objecter 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 Processor -- start 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 -- start start 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 librados: setting wanted keys 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 librados: calling monclient init 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: init 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: _reopen_session rank -1 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient(hunting): picked mon.noname-b con 0x7f275408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient(hunting): picked mon.noname-a con 0x7f275408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient(hunting): picked mon.noname-c con 0x7f275408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2754125c30 con 0x7f275408d8d0 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2754122c80 con 0x7f275408d4d0 2026-02-21T01:30:02.886 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275405e1b0 con 0x7f275408ddb0 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient(hunting): _renew_subs 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient(hunting): authenticate will time out at 734.581586s 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f27537fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f275408d8d0 0x7f2754122570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:47476/0 (socket says 10.20.193.43:47476) 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f27537fe640 1 -- 10.20.193.43:0/3804766145 learned_addr learned my addr 10.20.193.43:0/3804766145 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2753fff640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.46:6789/0 conn(0x7f275408d4d0 legacy=0x7f2754121e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.46:6789/0 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 client.?.objecter ms_handle_connect 0x7f275408d8d0 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 client.?.objecter ms_handle_connect 0x7f275408ddb0 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304269656 0 0) 0x7f2754125c30 con 0x7f275408d8d0 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): my global_id is 24621 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2724003610 con 0x7f275408d8d0 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216284255 0 0) 0x7f275405e1b0 con 0x7f275408ddb0 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.887 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): my global_id is 74186 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2754125c30 con 0x7f275408ddb0 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1546686638 0 0) 0x7f2724003610 con 0x7f275408d8d0 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f275405e1b0 con 0x7f275408d8d0 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2744002db0 con 0x7f275408d8d0 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): dump: 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 822620709 0 0) 0x7f2754125c30 con 0x7f275408ddb0 2026-02-21T01:30:02.888 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2724003610 con 0x7f275408ddb0 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2748004420 con 0x7f275408ddb0 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient(hunting): dump: 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 978554843 0 0) 0x7f275405e1b0 con 0x7f275408d8d0 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.43:6790/0 conn(0x7f275408ddb0 legacy=0x7f275419b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.46:6789/0 conn(0x7f275408d4d0 legacy=0x7f2754121e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:30:02.889 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 monclient: found mon.a 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2754124dc0 con 0x7f275408d8d0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: _finish_auth 0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 5 monclient: authenticate success, global_id 24621 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: _renew_subs 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27541238d0 con 0x7f275408d8d0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 client.24621.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: _renew_subs 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2754126050 con 0x7f275408d8d0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f275a493640 1 librados: init done 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2744004ca0 con 0x7f275408d8d0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f27440050b0 con 0x7f275408d8d0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.890 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f2750ff9640 10 monclient: dump: 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.875+0000 7f27527fc640 4 set_mon_vals no callback set 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f275a493640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f275408edd0 con 0x7f27541a10d0 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 client.24621.objecter ms_handle_connect 0x7f27541a10d0 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 client.24621.objecter resend_mon_ops 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f2744005250 con 0x7f275408d8d0 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(107..107 src has 1..107) ==== 6423+0+0 (unknown 394907342 0 0) 0x7f274404e8c0 con 0x7f275408d8d0 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 client.24621.objecter ms_dispatch2 0x7f2754000b90 osd_map(107..107 src has 1..107) 2026-02-21T01:30:02.891 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 3 client.24621.objecter handle_osd_map got epochs [107,107] > 0 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 3 client.24621.objecter handle_osd_map decoding full epoch 107 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 20 client.24621.objecter dump_active .. 0 homeless 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644678596 0 0) 0x7f275408edd0 con 0x7f27541a10d0 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 monclient(hunting): my global_id is 74189 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f275405e1b0 con 0x7f27541a10d0 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1621381432 0 0) 0x7f275405e1b0 con 0x7f27541a10d0 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f275408edd0 con 0x7f27541a10d0 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2740003020 con 0x7f27541a10d0 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 10 monclient: dump: 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.892 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2758a09640 10 monclient: get_auth_request con 0x7f272403e840 auth_method 0 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4103857908 0 0) 0x7f275408edd0 con 0x7f27541a10d0 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.876+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2754125520 con 0x7f27541a10d0 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.877+0000 7f2750ff9640 10 client.24621.objecter ms_handle_connect 0x7f272403e840 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.877+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f27400029c0 con 0x7f27541a10d0 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.877+0000 7f2750ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.877+0000 7f2750ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.877+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.43:6790/0 conn(0x7f27541a10d0 legacy=0x7f2754059220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.877+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.43:6790/0 conn(0x7f27541a10d0 legacy=0x7f2754059220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f275a493640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f27540574c0 con 0x7f2754059930 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 client.24621.objecter ms_handle_connect 0x7f2754059930 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 client.24621.objecter resend_mon_ops 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962070653 0 0) 0x7f27540574c0 con 0x7f2754059930 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:30:02.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 monclient(hunting): my global_id is 74192 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f275408edd0 con 0x7f2754059930 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1466609332 0 0) 0x7f275408edd0 con 0x7f2754059930 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27540574c0 con 0x7f2754059930 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2740004a70 con 0x7f2754059930 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 10 monclient: dump: 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1167636364 0 0) 0x7f27540574c0 con 0x7f2754059930 2026-02-21T01:30:02.895 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.880+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2754054ff0 con 0x7f2754059930 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4471 (unknown 0 0 2614865306) 0x7f2740005e20 con 0x7f2754059930 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f2750ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f2750ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.43:6790/0 conn(0x7f2754059930 legacy=0x7f2754110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f2750ff9640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.43:6790/0 conn(0x7f2754059930 legacy=0x7f2754110760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 14, 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 16620, 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:30:02.896 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:30:02.897 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:30:02.898 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.899 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:30:02.900 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.901 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.902 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "num": 4 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:30:02.903 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 10 librados: watch_flush enter 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 10 librados: watch_flush exit 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 20 client.24621.objecter shutdown clearing up homeless session... 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 10 client.24621.objecter successfully canceled tick 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.46:6812/860801619 conn(0x7f272403e840 legacy=0x7f272405ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 10 monclient: shutdown 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 >> v1:10.20.193.43:6789/0 conn(0x7f275408d8d0 legacy=0x7f2754122570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:30:02.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f2758a09640 1 -- 10.20.193.43:0/3804766145 reap_dead start 2026-02-21T01:30:02.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f2758a09640 1 -- 10.20.193.43:0/3804766145 reap_dead start 2026-02-21T01:30:02.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 shutdown_connections 2026-02-21T01:30:02.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 >> 10.20.193.43:0/3804766145 conn(0x7f275408f480 msgr2=0x7f275411f870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:30:02.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 shutdown_connections 2026-02-21T01:30:02.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 1 -- 10.20.193.43:0/3804766145 wait complete. 2026-02-21T01:30:02.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:30:02.881+0000 7f275a493640 1 librados: shutdown 2026-02-21T01:30:02.905 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:30:02.905 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-21T01:30:09.412 INFO:tasks.workunit.client.0.trial046.stdout: apiOK ] LibRadosSnapshotsECPP.RollbackPP (2009 ms) 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1992 ms) 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9001 ms total) 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (3998 ms) 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-21T01:30:09.413 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (18131 ms) 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3872 ms) 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (26002 ms total) 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (107237 ms total) 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-21T01:30:09.414 INFO:tasks.workunit.client.0.trial046.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-21T01:30:11.417 INFO:tasks.workunit.client.0.trial046.stdout:46 ms total) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (40 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (40 ms total) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (10 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (0 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (11 ms total) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (11 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (1 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (12 ms total) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (1 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (1 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (3 ms total) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1006 ms) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1006 ms total) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (109241 ms total) 2026-02-21T01:30:11.418 INFO:tasks.workunit.client.0.trial046.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45707 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45707 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=44995 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 44995 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45060 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45060 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45619 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45619 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=44986 2026-02-21T01:30:11.419 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 44986 2026-02-21T01:30:19.411 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: Running main() from gmock_main.cc 2026-02-21T01:30:19.411 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-21T01:30:19.412 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-21T01:30:19.412 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-21T01:30:19.412 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-21T01:30:19.412 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2712 ms) 2026-02-21T01:30:19.412 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-21T01:30:19.412 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (21537 ms) 2026-02-21T01:30:19.412 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (6002 ms) 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3001 ms) 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3004 ms) 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2990 ms) 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2998 ms) 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-21T01:30:19.413 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3007 ms) 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2993 ms) 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3004 ms) 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2999 ms) 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3004 ms) 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-21T01:30:19.414 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3001 ms) 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (2991 ms) 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3003 ms) 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2999 ms) 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2999 ms) 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-21T01:30:19.415 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3004 ms) 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3004 ms) 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3003 ms) 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3109 ms) 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (17884 ms) 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2997 ms) 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-21T01:30:19.416 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3005 ms) 2026-02-21T01:30:19.417 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-21T01:30:19.417 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3009 ms) 2026-02-21T01:30:19.417 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-21T01:30:19.417 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (2983 ms) 2026-02-21T01:30:19.417 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-21T01:30:19.448 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAi: cursor()=9:89d3ae78:::11:head expected=9:89d3ae78:::11:head 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:89d3ae78:::11:head -> 11 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=11 expected=11 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:863748b0:::15:head 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:863748b0:::15:head expected=9:863748b0:::15:head 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:863748b0:::15:head -> 15 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=15 expected=15 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:02547ec2:::1:head 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:02547ec2:::1:head expected=9:02547ec2:::1:head 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:02547ec2:::1:head -> 1 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=1 expected=1 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:bd63b0f1:::8:head 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:bd63b0f1:::8:head expected=9:bd63b0f1:::8:head 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:bd63b0f1:::8:head -> 8 2026-02-21T01:30:19.449 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=8 expected=8 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:6cac518f:::0:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:6cac518f:::0:head expected=9:6cac518f:::0:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:6cac518f:::0:head -> 0 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=0 expected=0 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:62a1935d:::14:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:62a1935d:::14:head expected=9:62a1935d:::14:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:62a1935d:::14:head -> 14 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=14 expected=14 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:5c6b0b28:::7:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:5c6b0b28:::7:head expected=9:5c6b0b28:::7:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:5c6b0b28:::7:head -> 7 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=7 expected=7 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : seek to 9:566253c9:::13:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : cursor()=9:566253c9:::13:head expected=9:566253c9:::13:head 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: > 9:566253c9:::13:head -> 13 2026-02-21T01:30:19.450 INFO:tasks.workunit.client.0.trial046.stdout: api_list: : entry=13 expected=13 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (100 ms) 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (102272 ms) 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: split 0/5 -> MIN 9:33333333::::head 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: split 1/5 -> 9:33333333::::head 9:66666666::::head 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: split 2/5 -> 9:66666666::::head 9:99999999::::head 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: split 3/5 -> 9:99999999::::head 9:cccccccc::::head 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: split 4/5 -> 9:cccccccc::::head MAX 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (7993 ms) 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] 7 tests from LibRadosList (110571 ms total) 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1011 ms) 2026-02-21T01:30:19.451 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset foo1,foo2,foo3 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo1 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo2 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo3 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset foo1,foo4,foo5 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo4 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo5 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo1 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset foo6,foo7 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo7 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: foo6 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns1:foo4 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns1:foo5 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns2:foo7 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns2:foo6 2026-02-21T01:30:19.452 INFO:tasks.workunit.client.0.trial046.stdout: api_list: ns1:foo1 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: :foo1 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: :foo2 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: :foo3 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (15 ms) 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 1 0 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 10 0 2026-02-21T01:30:19.453 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 13 0 2026-02-21T01:30:25.414 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 7 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 14 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 0 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 15 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 11 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 5 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 8 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 6 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 3 0 2026-02-21T01:30:25.415 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 4 0 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 12 0 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 9 0 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 2 0 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (23 ms) 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] 3 tests from LibRadosListEC (1050 ms total) 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2998 ms) 2026-02-21T01:30:25.416 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] 1 test from LibRadosListNP (2998 ms total) 2026-02-21T01:30:25.417 INFO:tasks.workunit.client.0.trial046.stdout: api_list: 2026-02-21T01:30:25.417 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [----------] Global test environment tear-down 2026-02-21T01:30:25.417 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [==========] 11 tests from 3 test suites ran. (123250 ms total) 2026-02-21T01:30:25.417 INFO:tasks.workunit.client.0.trial046.stdout: api_list: [ PASSED ] 11 tests. 2026-02-21T01:31:32.906 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-21T01:31:32.906 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-21T01:31:32.906 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-21T01:31:32.921 INFO:tasks.ceph.mon.b:Started 2026-02-21T01:31:32.921 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:31:32.921 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:31:33.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.004+0000 7f097116f640 10 monclient: get_monmap_and_config 2026-02-21T01:31:33.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.004+0000 7f097116f640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.004+0000 7f097116f640 10 monclient: monmap: 2026-02-21T01:31:33.015 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.015 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:33.006069+0000 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:33.006069+0000 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 1 Processor -- start 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 1 -- start start 2026-02-21T01:31:33.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient: init 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient(hunting): picked mon.noname-a con 0x7f096c1434a0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient(hunting): picked mon.noname-b con 0x7f096c05d690 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient(hunting): picked mon.noname-c con 0x7f096c143870 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c08b970 con 0x7f096c1434a0 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c144380 con 0x7f096c143870 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c08b590 con 0x7f096c05d690 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f097116f640 10 monclient(hunting): authenticate will time out at 824.711523s 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f096a575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f096c05d690 0x7f096c1847e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50902/0 (socket says 10.20.193.43:50902) 2026-02-21T01:31:33.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f096a575640 1 -- 10.20.193.43:0/2554382303 learned_addr learned my addr 10.20.193.43:0/2554382303 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.005+0000 7f096ad76640 1 --1- 10.20.193.43:0/2554382303 >> v1:10.20.193.43:6789/0 conn(0x7f096c1434a0 0x7f096c088de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40570/0 (socket says 10.20.193.43:40570) 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585105228 0 0) 0x7f096c08b590 con 0x7f096c05d690 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient(hunting): my global_id is 74420 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0958003610 con 0x7f096c05d690 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2053099611 0 0) 0x7f0958003610 con 0x7f096c05d690 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 >> v1:10.20.193.46:6789/0 conn(0x7f096c143870 legacy=0x7f096c1a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 >> v1:10.20.193.43:6789/0 conn(0x7f096c1434a0 legacy=0x7f096c088de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 monclient: found mon.noname-b 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0868a0 con 0x7f096c05d690 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0954002df0 con 0x7f096c05d690 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: dump: 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.020 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 5 monclient: authenticate success, global_id 74420 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0954003080 con 0x7f096c05d690 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 1 -- 10.20.193.43:0/2554382303 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f09540034c0 con 0x7f096c05d690 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f0969d74640 10 monclient: dump: 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.022 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 4 set_mon_vals no callback set 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 10 monclient: shutdown 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 1 -- 10.20.193.43:0/2554382303 >> v1:10.20.193.43:6790/0 conn(0x7f096c05d690 legacy=0x7f096c1847e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 1 -- 10.20.193.43:0/2554382303 shutdown_connections 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 1 -- 10.20.193.43:0/2554382303 >> 10.20.193.43:0/2554382303 conn(0x7f096c08f480 msgr2=0x7f096c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 1 -- 10.20.193.43:0/2554382303 shutdown_connections 2026-02-21T01:31:33.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.006+0000 7f097116f640 1 -- 10.20.193.43:0/2554382303 wait complete. 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient: monmap: 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:33.024 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 librados: starting msgr at 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 librados: starting objecter 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 Processor -- start 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 -- start start 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 librados: setting wanted keys 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 librados: calling monclient init 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient: init 2026-02-21T01:31:33.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient(hunting): picked mon.noname-a con 0x7f096c1434a0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient(hunting): picked mon.noname-b con 0x7f096c143870 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient(hunting): picked mon.noname-c con 0x7f096c12fd80 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c1327f0 con 0x7f096c1434a0 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c086dc0 con 0x7f096c143870 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c087310 con 0x7f096c12fd80 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f097116f640 10 monclient(hunting): authenticate will time out at 824.713751s 2026-02-21T01:31:33.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f096ad76640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f096c1434a0 0x7f096c1538b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40586/0 (socket says 10.20.193.43:40586) 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f096ad76640 1 -- 10.20.193.43:0/2717732604 learned_addr learned my addr 10.20.193.43:0/2717732604 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f094b7fe640 10 client.?.objecter ms_handle_connect 0x7f096c1434a0 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f094b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f094b7fe640 10 client.?.objecter ms_handle_connect 0x7f096c12fd80 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.007+0000 7f094b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 client.?.objecter ms_handle_connect 0x7f096c143870 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21152205 0 0) 0x7f096c087310 con 0x7f096c12fd80 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): my global_id is 74423 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0938003610 con 0x7f096c12fd80 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1055710781 0 0) 0x7f096c1327f0 con 0x7f096c1434a0 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 10 monclient(hunting): my global_id is 24849 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.008+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f096c087310 con 0x7f096c1434a0 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1066791923 0 0) 0x7f096c087310 con 0x7f096c1434a0 2026-02-21T01:31:33.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f096c1327f0 con 0x7f096c1434a0 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f09600030d0 con 0x7f096c1434a0 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient(hunting): dump: 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.029 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1396969790 0 0) 0x7f096c1327f0 con 0x7f096c1434a0 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 >> v1:10.20.193.43:6790/0 conn(0x7f096c12fd80 legacy=0x7f096c1961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 >> v1:10.20.193.46:6789/0 conn(0x7f096c143870 legacy=0x7f096c194ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 monclient: found mon.a 2026-02-21T01:31:33.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c05e1b0 con 0x7f096c1434a0 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 5 monclient: authenticate success, global_id 24849 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 monclient: _renew_subs 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f096c132510 con 0x7f096c1434a0 2026-02-21T01:31:33.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 client.24849.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 monclient: _renew_subs 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f096c153fc0 con 0x7f096c1434a0 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 1 librados: init done 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c0008d0 con 0x7f096c1434a0 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09600034a0 con 0x7f096c1434a0 2026-02-21T01:31:33.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0960004b80 con 0x7f096c1434a0 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f0969573640 4 set_mon_vals no callback set 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.009+0000 7f094b7fe640 10 monclient: dump: 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.033 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f0960004d20 con 0x7f096c1434a0 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(197..197 src has 1..197) ==== 4865+0+0 (unknown 957367286 0 0) 0x7f096004e2c0 con 0x7f096c1434a0 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f094b7fe640 10 client.24849.objecter ms_dispatch2 0x7f096c000b90 osd_map(197..197 src has 1..197) 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f094b7fe640 3 client.24849.objecter handle_osd_map got epochs [197,197] > 0 2026-02-21T01:31:33.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f094b7fe640 3 client.24849.objecter handle_osd_map decoding full epoch 197 2026-02-21T01:31:33.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f094b7fe640 20 client.24849.objecter dump_active .. 0 homeless 2026-02-21T01:31:33.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f096a575640 10 monclient: get_auth_request con 0x7f093803eaa0 auth_method 0 2026-02-21T01:31:33.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.010+0000 7f094b7fe640 10 client.24849.objecter ms_handle_connect 0x7f093803eaa0 2026-02-21T01:31:33.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.012+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f0960017750 con 0x7f096c1434a0 2026-02-21T01:31:33.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.012+0000 7f094b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.035 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.012+0000 7f094b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:33.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.163+0000 7f097116f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:31:33.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.163+0000 7f097116f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:33.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.163+0000 7f097116f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.163+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f096c1542b0 con 0x7f096c1434a0 2026-02-21T01:31:33.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.163+0000 7f094b7fe640 1 -- 10.20.193.43:0/2717732604 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 1197953153) 0x7f0960017050 con 0x7f096c1434a0 2026-02-21T01:31:33.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.163+0000 7f094b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.163+0000 7f094b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 10 librados: watch_flush enter 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 10 librados: watch_flush exit 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 20 client.24849.objecter shutdown clearing up homeless session... 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 10 client.24849.objecter successfully canceled tick 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 >> v1:10.20.193.46:6812/860801619 conn(0x7f093803eaa0 legacy=0x7f093805ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 10 monclient: shutdown 2026-02-21T01:31:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 >> v1:10.20.193.43:6789/0 conn(0x7f096c1434a0 legacy=0x7f096c1538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 shutdown_connections 2026-02-21T01:31:33.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 >> 10.20.193.43:0/2717732604 conn(0x7f096c08f480 msgr2=0x7f096c0875b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 shutdown_connections 2026-02-21T01:31:33.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 1 -- 10.20.193.43:0/2717732604 wait complete. 2026-02-21T01:31:33.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.164+0000 7f097116f640 1 librados: shutdown 2026-02-21T01:31:33.173 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:31:33.173 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:31:33.173 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.241+0000 7f2186345640 10 monclient: get_monmap_and_config 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.241+0000 7f2186345640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.241+0000 7f2186345640 10 monclient: monmap: 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:33.242715+0000 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:33.242715+0000 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.242 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.243 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.243 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:33.243 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:33.243 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.241+0000 7f2186345640 1 Processor -- start 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.241+0000 7f2186345640 1 -- start start 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.241+0000 7f2186345640 10 monclient: init 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient(hunting): picked mon.noname-a con 0x7f2180058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient(hunting): picked mon.noname-b con 0x7f2180057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient(hunting): picked mon.noname-c con 0x7f2180181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2180056c50 con 0x7f2180058260 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f218008eda0 con 0x7f2180181e80 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f218008f5c0 con 0x7f2180057630 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient(hunting): authenticate will time out at 824.948250s 2026-02-21T01:31:33.244 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217ffff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f2180058260 0x7f218008df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40598/0 (socket says 10.20.193.43:40598) 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217ffff640 1 -- 10.20.193.43:0/4177739638 learned_addr learned my addr 10.20.193.43:0/4177739638 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394869940 0 0) 0x7f2180056c50 con 0x7f2180058260 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): my global_id is 24852 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2164003610 con 0x7f2180058260 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905695369 0 0) 0x7f218008f5c0 con 0x7f2180057630 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient(hunting): my global_id is 74426 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2180056c50 con 0x7f2180057630 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3878420650 0 0) 0x7f2164003610 con 0x7f2180058260 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 >> v1:10.20.193.43:6790/0 conn(0x7f2180057630 legacy=0x7f218008e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 >> v1:10.20.193.46:6789/0 conn(0x7f2180181e80 legacy=0x7f21801a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 monclient: found mon.noname-a 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21800563b0 con 0x7f2180058260 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f216c002df0 con 0x7f2180058260 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 5 monclient: authenticate success, global_id 24852 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: dump: 2026-02-21T01:31:33.245 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f216c002fc0 con 0x7f2180058260 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 1 -- 10.20.193.43:0/4177739638 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f216c003400 con 0x7f2180058260 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 4 set_mon_vals no callback set 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f217effd640 10 monclient: dump: 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.246 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 10 monclient: shutdown 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 1 -- 10.20.193.43:0/4177739638 >> v1:10.20.193.43:6789/0 conn(0x7f2180058260 legacy=0x7f218008df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 1 -- 10.20.193.43:0/4177739638 shutdown_connections 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.242+0000 7f2186345640 1 -- 10.20.193.43:0/4177739638 >> 10.20.193.43:0/4177739638 conn(0x7f2180090360 msgr2=0x7f2180090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 -- 10.20.193.43:0/4177739638 shutdown_connections 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 -- 10.20.193.43:0/4177739638 wait complete. 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient: monmap: 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.247 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.248 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.248 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:33.248 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:33.248 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 librados: starting msgr at 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 librados: starting objecter 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 Processor -- start 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 -- start start 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 librados: setting wanted keys 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 librados: calling monclient init 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient: init 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient(hunting): picked mon.noname-c con 0x7f2180057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient(hunting): picked mon.noname-b con 0x7f2180058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient(hunting): picked mon.noname-a con 0x7f2180181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2180149500 con 0x7f2180181e80 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2180130750 con 0x7f2180058260 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f218012f8e0 con 0x7f2180057630 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.251 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f2186345640 10 monclient(hunting): authenticate will time out at 824.949873s 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f217ffff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f2180057630 0x7f2180148df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50946/0 (socket says 10.20.193.43:50946) 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f217ffff640 1 -- 10.20.193.43:0/3402567340 learned_addr learned my addr 10.20.193.43:0/3402567340 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f217cff9640 10 client.?.objecter ms_handle_connect 0x7f2180057630 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f217cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f217cff9640 10 client.?.objecter ms_handle_connect 0x7f2180181e80 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f217cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.243+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499580490 0 0) 0x7f218012f8e0 con 0x7f2180057630 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): my global_id is 74429 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2150003610 con 0x7f2180057630 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661611144 0 0) 0x7f2180149500 con 0x7f2180181e80 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): my global_id is 24855 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f218012f8e0 con 0x7f2180181e80 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3208152177 0 0) 0x7f2150003610 con 0x7f2180057630 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2180149500 con 0x7f2180057630 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f216c003310 con 0x7f2180057630 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): dump: 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.252 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3587122499 0 0) 0x7f218012f8e0 con 0x7f2180181e80 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2150003610 con 0x7f2180181e80 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 client.?.objecter ms_handle_connect 0x7f2180058260 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2174003040 con 0x7f2180181e80 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): dump: 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.253 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2656452754 0 0) 0x7f2180149500 con 0x7f2180057630 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.46:6789/0 conn(0x7f2180058260 legacy=0x7f21801701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.43:6789/0 conn(0x7f2180181e80 legacy=0x7f21801718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 monclient: found mon.c 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218012e3f0 con 0x7f2180057630 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 5 monclient: authenticate success, global_id 74429 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 10 monclient: _renew_subs 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f218012ff10 con 0x7f2180057630 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 10 client.74429.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 10 monclient: _renew_subs 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f218012f130 con 0x7f2180057630 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 1 librados: init done 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f216c004ce0 con 0x7f2180057630 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f216c005030 con 0x7f2180057630 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient: dump: 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.254 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217e7fc640 4 set_mon_vals no callback set 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2180130300 con 0x7f218014bde0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 client.74429.objecter ms_handle_connect 0x7f218014bde0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 client.74429.objecter resend_mon_ops 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395159268 0 0) 0x7f2180130750 con 0x7f218014bde0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 monclient(hunting): my global_id is 24858 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2180149500 con 0x7f218014bde0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f216c011a30 con 0x7f2180057630 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(197..197 src has 1..197) ==== 4865+0+0 (unknown 957367286 0 0) 0x7f216c04e300 con 0x7f2180057630 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 10 client.74429.objecter ms_dispatch2 0x7f2180000b90 osd_map(197..197 src has 1..197) 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 3 client.74429.objecter handle_osd_map got epochs [197,197] > 0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.244+0000 7f217cff9640 3 client.74429.objecter handle_osd_map decoding full epoch 197 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 20 client.74429.objecter dump_active .. 0 homeless 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3416689416 0 0) 0x7f2180149500 con 0x7f218014bde0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2180130750 con 0x7f218014bde0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2170002d90 con 0x7f218014bde0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 10 monclient: dump: 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f21848bb640 10 monclient: get_auth_request con 0x7f215003e9b0 auth_method 0 2026-02-21T01:31:33.255 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1772498324 0 0) 0x7f2180130750 con 0x7f218014bde0 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f218014c1b0 con 0x7f218014bde0 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 10 client.74429.objecter ms_handle_connect 0x7f215003e9b0 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f21700030a0 con 0x7f218014bde0 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.43:6789/0 conn(0x7f218014bde0 legacy=0x7f2180087f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.245+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.43:6789/0 conn(0x7f218014bde0 legacy=0x7f2180087f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f2186345640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2180054d90 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 client.74429.objecter ms_handle_connect 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 client.74429.objecter resend_mon_ops 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312197708 0 0) 0x7f2180054d90 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient(hunting): my global_id is 24861 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2180130750 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3397518672 0 0) 0x7f2180130750 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2180054d90 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2170003660 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient: dump: 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3254378173 0 0) 0x7f2180054d90 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2180092830 con 0x7f218004ca30 2026-02-21T01:31:33.256 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4318 (unknown 0 0 3697778914) 0x7f21700050f0 con 0x7f218004ca30 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.248+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.43:6789/0 conn(0x7f218004ca30 legacy=0x7f2180173ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f217cff9640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.43:6789/0 conn(0x7f218004ca30 legacy=0x7f2180173ff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 20, 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 228879, 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.257 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:33.258 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:33.259 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:33.260 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:33.261 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 10 librados: watch_flush enter 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 10 librados: watch_flush exit 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 20 client.74429.objecter shutdown clearing up homeless session... 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 10 client.74429.objecter successfully canceled tick 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.46:6812/860801619 conn(0x7f215003e9b0 legacy=0x7f215005ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 10 monclient: shutdown 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 >> v1:10.20.193.43:6790/0 conn(0x7f2180057630 legacy=0x7f2180148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f21848bb640 1 -- 10.20.193.43:0/3402567340 reap_dead start 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f21848bb640 1 -- 10.20.193.43:0/3402567340 reap_dead start 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 shutdown_connections 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 >> 10.20.193.43:0/3402567340 conn(0x7f2180090360 msgr2=0x7f218008ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 shutdown_connections 2026-02-21T01:31:33.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 1 -- 10.20.193.43:0/3402567340 wait complete. 2026-02-21T01:31:33.263 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.249+0000 7f2186345640 1 librados: shutdown 2026-02-21T01:31:33.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:31:33.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:31:33.263 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:31:33.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient: get_monmap_and_config 2026-02-21T01:31:33.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient: monmap: 2026-02-21T01:31:33.330 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.330 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:33.330564+0000 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:33.330564+0000 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:33.331 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 1 Processor -- start 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 1 -- start start 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient: init 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient(hunting): picked mon.noname-a con 0x7f48bc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient(hunting): picked mon.noname-b con 0x7f48bc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient(hunting): picked mon.noname-c con 0x7f48bc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc08a690 con 0x7f48bc08ddb0 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc08b910 con 0x7f48bc08d8d0 2026-02-21T01:31:33.337 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc088ae0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.329+0000 7f48c15a2640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 10 monclient(hunting): authenticate will time out at 825.036005s 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48baffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f48bc08ddb0 0x7f48bc08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40628/0 (socket says 10.20.193.43:40628) 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48baffd640 1 -- 10.20.193.43:0/2786600914 learned_addr learned my addr 10.20.193.43:0/2786600914 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173785199 0 0) 0x7f48bc08a690 con 0x7f48bc08ddb0 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): my global_id is 24864 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48a8003610 con 0x7f48bc08ddb0 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099998752 0 0) 0x7f48bc088ae0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.338 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient(hunting): my global_id is 74432 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc08a690 con 0x7f48bc08d4d0 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4130122997 0 0) 0x7f48a8003610 con 0x7f48bc08ddb0 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 >> v1:10.20.193.43:6790/0 conn(0x7f48bc08d4d0 legacy=0x7f48bc17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 >> v1:10.20.193.46:6789/0 conn(0x7f48bc08d8d0 legacy=0x7f48bc19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 monclient: found mon.noname-a 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc1a3ef0 con 0x7f48bc08ddb0 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.339 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48b0002df0 con 0x7f48bc08ddb0 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: dump: 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.340 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 5 monclient: authenticate success, global_id 24864 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48b00030b0 con 0x7f48bc08ddb0 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 1 -- 10.20.193.43:0/2786600914 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48b00034f0 con 0x7f48bc08ddb0 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48b9ffb640 10 monclient: dump: 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.341 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 4 set_mon_vals no callback set 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 10 monclient: shutdown 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 1 -- 10.20.193.43:0/2786600914 >> v1:10.20.193.43:6789/0 conn(0x7f48bc08ddb0 legacy=0x7f48bc08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 1 -- 10.20.193.43:0/2786600914 shutdown_connections 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 1 -- 10.20.193.43:0/2786600914 >> 10.20.193.43:0/2786600914 conn(0x7f48bc08f480 msgr2=0x7f48bc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 1 -- 10.20.193.43:0/2786600914 shutdown_connections 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.330+0000 7f48c15a2640 1 -- 10.20.193.43:0/2786600914 wait complete. 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.342 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: monmap: 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 librados: starting msgr at 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 librados: starting objecter 2026-02-21T01:31:33.343 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 Processor -- start 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 -- start start 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 librados: setting wanted keys 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 librados: calling monclient init 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: init 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient(hunting): picked mon.noname-c con 0x7f48bc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient(hunting): picked mon.noname-a con 0x7f48bc08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient(hunting): picked mon.noname-b con 0x7f48bc08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc05e1b0 con 0x7f48bc08d8d0 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc10d010 con 0x7f48bc08ddb0 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc10d2f0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient(hunting): authenticate will time out at 825.037607s 2026-02-21T01:31:33.344 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48ba7fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f48bc08d8d0 0x7f48bc18d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40642/0 (socket says 10.20.193.43:40642) 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48ba7fc640 1 -- 10.20.193.43:0/2400595187 learned_addr learned my addr 10.20.193.43:0/2400595187 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48baffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f48bc08d4d0 0x7f48bc11d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50972/0 (socket says 10.20.193.43:50972) 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 client.?.objecter ms_handle_connect 0x7f48bc08d8d0 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 client.?.objecter ms_handle_connect 0x7f48bc08d4d0 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433982945 0 0) 0x7f48bc05e1b0 con 0x7f48bc08d8d0 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): my global_id is 24867 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4888003610 con 0x7f48bc08d8d0 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517395090 0 0) 0x7f48bc10d2f0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): my global_id is 74435 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc05e1b0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2350460781 0 0) 0x7f4888003610 con 0x7f48bc08d8d0 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48bc10d2f0 con 0x7f48bc08d8d0 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 531146231 0 0) 0x7f48bc05e1b0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4888003610 con 0x7f48bc08d4d0 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48a40031c0 con 0x7f48bc08d8d0 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): dump: 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.346 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 client.?.objecter ms_handle_connect 0x7f48bc08ddb0 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48b0002c10 con 0x7f48bc08d4d0 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient(hunting): dump: 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 255462264 0 0) 0x7f4888003610 con 0x7f48bc08d4d0 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.46:6789/0 conn(0x7f48bc08ddb0 legacy=0x7f48bc18ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.43:6789/0 conn(0x7f48bc08d8d0 legacy=0x7f48bc18d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 monclient: found mon.c 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc10baf0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 5 monclient: authenticate success, global_id 74435 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: _renew_subs 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc11e020 con 0x7f48bc08d4d0 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 client.74435.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: _renew_subs 2026-02-21T01:31:33.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48b0002db0 con 0x7f48bc08d4d0 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.331+0000 7f48c15a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f48bc14c540 con 0x7f48bc08d4d0 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f48c15a2640 1 librados: init done 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48b0004f00 con 0x7f48bc08d4d0 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient: dump: 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.350 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f48b97fa640 4 set_mon_vals no callback set 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f48c15a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48bc08edb0 con 0x7f48bc1a10d0 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f48b0011880 con 0x7f48bc08d4d0 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 client.74435.objecter ms_handle_connect 0x7f48bc1a10d0 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 client.74435.objecter resend_mon_ops 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(197..197 src has 1..197) ==== 4865+0+0 (unknown 957367286 0 0) 0x7f48b004e090 con 0x7f48bc08d4d0 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 client.74435.objecter ms_dispatch2 0x7f48bc000b90 osd_map(197..197 src has 1..197) 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 3 client.74435.objecter handle_osd_map got epochs [197,197] > 0 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 3 client.74435.objecter handle_osd_map decoding full epoch 197 2026-02-21T01:31:33.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 20 client.74435.objecter dump_active .. 0 homeless 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004670352 0 0) 0x7f48bc08edb0 con 0x7f48bc1a10d0 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient(hunting): my global_id is 74438 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4888003610 con 0x7f48bc1a10d0 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2507326168 0 0) 0x7f4888003610 con 0x7f48bc1a10d0 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48bc08edb0 con 0x7f48bc1a10d0 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48a4003bf0 con 0x7f48bc1a10d0 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 10 monclient: dump: 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.352 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f48bb7fe640 10 monclient: get_auth_request con 0x7f488803e910 auth_method 0 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3840022217 0 0) 0x7f48bc08edb0 con 0x7f48bc1a10d0 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.332+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48bc057410 con 0x7f48bc1a10d0 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.333+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f48a4003aa0 con 0x7f48bc1a10d0 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.333+0000 7f489b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.353 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.333+0000 7f489b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:33.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.333+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.43:6790/0 conn(0x7f48bc1a10d0 legacy=0x7f48bc0594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.333+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.43:6790/0 conn(0x7f48bc1a10d0 legacy=0x7f48bc0594b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:33.354 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.333+0000 7f489b7fe640 10 client.74435.objecter ms_handle_connect 0x7f488803e910 2026-02-21T01:31:33.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f48c15a2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:33.355 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48bc054ff0 con 0x7f48bc059bc0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 client.74435.objecter ms_handle_connect 0x7f48bc059bc0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 client.74435.objecter resend_mon_ops 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026244399 0 0) 0x7f48bc054ff0 con 0x7f48bc059bc0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient(hunting): my global_id is 74441 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc08edb0 con 0x7f48bc059bc0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3820325944 0 0) 0x7f48bc08edb0 con 0x7f48bc059bc0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48bc054ff0 con 0x7f48bc059bc0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f48a4005570 con 0x7f48bc059bc0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.356 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient: dump: 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1531616761 0 0) 0x7f48bc054ff0 con 0x7f48bc059bc0 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f48bc056fc0 con 0x7f48bc059bc0 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4483 (unknown 0 0 1622034969) 0x7f48a4006ab0 con 0x7f48bc059bc0 2026-02-21T01:31:33.357 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.43:6790/0 conn(0x7f48bc059bc0 legacy=0x7f48bc191510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.336+0000 7f489b7fe640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.43:6790/0 conn(0x7f48bc059bc0 legacy=0x7f48bc191510 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 20, 2026-02-21T01:31:33.358 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 107075, 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.359 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.360 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:33.361 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:33.362 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.363 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:33.364 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.365 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.366 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:31:33.367 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "num": 4 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.368 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.369 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.369 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:33.369 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 10 librados: watch_flush enter 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 10 librados: watch_flush exit 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 20 client.74435.objecter shutdown clearing up homeless session... 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 10 client.74435.objecter successfully canceled tick 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.46:6812/860801619 conn(0x7f488803e910 legacy=0x7f488805edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 10 monclient: shutdown 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 >> v1:10.20.193.43:6790/0 conn(0x7f48bc08d4d0 legacy=0x7f48bc11d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48bb7fe640 1 -- 10.20.193.43:0/2400595187 reap_dead start 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48bb7fe640 1 -- 10.20.193.43:0/2400595187 reap_dead start 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 shutdown_connections 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 >> 10.20.193.43:0/2400595187 conn(0x7f48bc08f480 msgr2=0x7f48bc1a2710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 shutdown_connections 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 1 -- 10.20.193.43:0/2400595187 wait complete. 2026-02-21T01:31:33.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.337+0000 7f48c15a2640 1 librados: shutdown 2026-02-21T01:31:33.370 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:31:33.370 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:31:33.371 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.437+0000 7fc327533640 10 monclient: get_monmap_and_config 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.437+0000 7fc327533640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.437+0000 7fc327533640 10 monclient: monmap: 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:33.439010+0000 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:33.439010+0000 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.439 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.440 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:33.440 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:33.440 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 1 Processor -- start 2026-02-21T01:31:33.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 1 -- start start 2026-02-21T01:31:33.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient: init 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient(hunting): picked mon.noname-b con 0x7fc32005cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient(hunting): picked mon.noname-a con 0x7fc32008a730 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient(hunting): picked mon.noname-c con 0x7fc32013fa20 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32005d9d0 con 0x7fc32008a730 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32008b590 con 0x7fc32013fa20 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32005b9c0 con 0x7fc32005cef0 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient(hunting): authenticate will time out at 825.144418s 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc3252a8640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fc32005cef0 0x7fc32005d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50996/0 (socket says 10.20.193.43:50996) 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc324aa7640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc32008a730 0x7fc320180300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40644/0 (socket says 10.20.193.43:40644) 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc3252a8640 1 -- 10.20.193.43:0/3522580493 learned_addr learned my addr 10.20.193.43:0/3522580493 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042454534 0 0) 0x7fc32005d9d0 con 0x7fc32008a730 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): my global_id is 24876 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc308003610 con 0x7fc32008a730 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392612082 0 0) 0x7fc32005b9c0 con 0x7fc32005cef0 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.445 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient(hunting): my global_id is 74450 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc32005d9d0 con 0x7fc32005cef0 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079327935 0 0) 0x7fc308003610 con 0x7fc32008a730 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 >> v1:10.20.193.43:6790/0 conn(0x7fc32005cef0 legacy=0x7fc32005d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 >> v1:10.20.193.46:6789/0 conn(0x7fc32013fa20 legacy=0x7fc3201a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 monclient: found mon.noname-a 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32013f210 con 0x7fc32008a730 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc314002df0 con 0x7fc32008a730 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: dump: 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 5 monclient: authenticate success, global_id 24876 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc314003030 con 0x7fc32008a730 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 1 -- 10.20.193.43:0/3522580493 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc314003470 con 0x7fc32008a730 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc327533640 4 set_mon_vals no callback set 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.438+0000 7fc30ffff640 10 monclient: dump: 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.446 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient: shutdown 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- 10.20.193.43:0/3522580493 >> v1:10.20.193.43:6789/0 conn(0x7fc32008a730 legacy=0x7fc320180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- 10.20.193.43:0/3522580493 shutdown_connections 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- 10.20.193.43:0/3522580493 >> 10.20.193.43:0/3522580493 conn(0x7fc32008f480 msgr2=0x7fc32008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- 10.20.193.43:0/3522580493 shutdown_connections 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- 10.20.193.43:0/3522580493 wait complete. 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient: monmap: 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 librados: starting msgr at 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 librados: starting objecter 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 Processor -- start 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- start start 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 librados: setting wanted keys 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 librados: calling monclient init 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient: init 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient(hunting): picked mon.noname-c con 0x7fc32005cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient(hunting): picked mon.noname-b con 0x7fc32008a730 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient(hunting): picked mon.noname-a con 0x7fc32013fa20 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32012c790 con 0x7fc32013fa20 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32012c370 con 0x7fc32008a730 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc320129400 con 0x7fc32005cef0 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc327533640 10 monclient(hunting): authenticate will time out at 825.145906s 2026-02-21T01:31:33.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc325aa9640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc32013fa20 0x7fc320191120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40658/0 (socket says 10.20.193.43:40658) 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc325aa9640 1 -- 10.20.193.43:0/2275356523 learned_addr learned my addr 10.20.193.43:0/2275356523 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc30dffb640 10 client.?.objecter ms_handle_connect 0x7fc32013fa20 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc30dffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc30dffb640 10 client.?.objecter ms_handle_connect 0x7fc32005cef0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.439+0000 7fc30dffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819906163 0 0) 0x7fc31c003d30 con 0x7fc32013fa20 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): my global_id is 24879 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f0003610 con 0x7fc32013fa20 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919557712 0 0) 0x7fc320129400 con 0x7fc32005cef0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): my global_id is 74453 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003d30 con 0x7fc32005cef0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 client.?.objecter ms_handle_connect 0x7fc32008a730 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 851257842 0 0) 0x7fc2f0003610 con 0x7fc32013fa20 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc320129400 con 0x7fc32013fa20 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc31c0045a0 con 0x7fc32013fa20 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): dump: 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3489210469 0 0) 0x7fc31c003d30 con 0x7fc32005cef0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2f0003610 con 0x7fc32005cef0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc310002ff0 con 0x7fc32005cef0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): dump: 2026-02-21T01:31:33.448 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927685807 0 0) 0x7fc32012c370 con 0x7fc32008a730 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient(hunting): my global_id is 84109 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003d30 con 0x7fc32008a730 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2794287251 0 0) 0x7fc320129400 con 0x7fc32013fa20 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.43:6790/0 conn(0x7fc32005cef0 legacy=0x7fc3201285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.46:6789/0 conn(0x7fc32008a730 legacy=0x7fc320128cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 monclient: found mon.a 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32005e1b0 con 0x7fc32013fa20 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 5 monclient: authenticate success, global_id 24879 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 10 monclient: _renew_subs 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc32012b500 con 0x7fc32013fa20 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 10 client.24879.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 10 monclient: _renew_subs 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc31c002d00 con 0x7fc32013fa20 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc32013bcb0 con 0x7fc32013fa20 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 1 librados: init done 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc31c002f30 con 0x7fc32013fa20 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 10 monclient: dump: 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.449 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30f7fe640 4 set_mon_vals no callback set 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3200008d0 con 0x7fc3200885f0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.440+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fc31c003150 con 0x7fc32013fa20 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 client.24879.objecter ms_handle_connect 0x7fc3200885f0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 client.24879.objecter resend_mon_ops 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(198..198 src has 1..198) ==== 4488+0+0 (unknown 136607979 0 0) 0x7fc31c04e570 con 0x7fc32013fa20 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 client.24879.objecter ms_dispatch2 0x7fc320000b90 osd_map(198..198 src has 1..198) 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 3 client.24879.objecter handle_osd_map got epochs [198,198] > 0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 3 client.24879.objecter handle_osd_map decoding full epoch 198 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 20 client.24879.objecter dump_active .. 0 homeless 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054446158 0 0) 0x7fc3200008d0 con 0x7fc3200885f0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient(hunting): my global_id is 84112 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc320129400 con 0x7fc3200885f0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc324aa7640 10 monclient: get_auth_request con 0x7fc2f003eb70 auth_method 0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 371623034 0 0) 0x7fc320129400 con 0x7fc3200885f0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3200008d0 con 0x7fc3200885f0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc3100048d0 con 0x7fc3200885f0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient: dump: 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.450 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4030572133 0 0) 0x7fc3200008d0 con 0x7fc3200885f0 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc32004d140 con 0x7fc3200885f0 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 client.24879.objecter ms_handle_connect 0x7fc2f003eb70 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc3100049a0 con 0x7fc3200885f0 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.46:6789/0 conn(0x7fc3200885f0 legacy=0x7fc32004ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.441+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.46:6789/0 conn(0x7fc3200885f0 legacy=0x7fc32004ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc327533640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3201a3360 con 0x7fc3200889c0 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 client.24879.objecter ms_handle_connect 0x7fc3200889c0 2026-02-21T01:31:33.451 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 client.24879.objecter resend_mon_ops 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537380988 0 0) 0x7fc3201a3360 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 monclient(hunting): my global_id is 84115 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3200008d0 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3421953973 0 0) 0x7fc3200008d0 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3201a3360 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc310004ff0 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 10 monclient: dump: 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3526488297 0 0) 0x7fc3201a3360 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.445+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc32012ade0 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4146 (unknown 0 0 2143161779) 0x7fc310007290 con 0x7fc3200889c0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc30dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc30dffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.46:6789/0 conn(0x7fc3200889c0 legacy=0x7fc320193850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc30dffb640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.46:6789/0 conn(0x7fc3200889c0 legacy=0x7fc320193850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:31:33.452 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 20, 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 463, 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.453 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:33.454 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:33.455 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:33.456 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 10 librados: watch_flush enter 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 10 librados: watch_flush exit 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 20 client.24879.objecter shutdown clearing up homeless session... 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 10 client.24879.objecter successfully canceled tick 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.46:6812/860801619 conn(0x7fc2f003eb70 legacy=0x7fc2f005f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 10 monclient: shutdown 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 >> v1:10.20.193.43:6789/0 conn(0x7fc32013fa20 legacy=0x7fc320191120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc325aa9640 1 -- 10.20.193.43:0/2275356523 reap_dead start 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 shutdown_connections 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 >> 10.20.193.43:0/2275356523 conn(0x7fc32008f480 msgr2=0x7fc32013de10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 shutdown_connections 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 1 -- 10.20.193.43:0/2275356523 wait complete. 2026-02-21T01:31:33.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.446+0000 7fc327533640 1 librados: shutdown 2026-02-21T01:31:33.457 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:31:33.457 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-21T01:31:33.457 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.522+0000 7fcd6d902640 10 monclient: get_monmap_and_config 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.522+0000 7fcd6d902640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.522+0000 7fcd6d902640 10 monclient: monmap: 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:33.524158+0000 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:33.524158+0000 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 1 Processor -- start 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 1 -- start start 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient: init 2026-02-21T01:31:33.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient(hunting): picked mon.noname-b con 0x7fcd6808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient(hunting): picked mon.noname-a con 0x7fcd6808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient(hunting): picked mon.noname-c con 0x7fcd6808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd6808a690 con 0x7fcd6808d4d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd6808b910 con 0x7fcd6808d8d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd68088ae0 con 0x7fcd6808ddb0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient(hunting): authenticate will time out at 825.229533s 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd66ffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fcd6808ddb0 0x7fcd6808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51022/0 (socket says 10.20.193.43:51022) 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd667fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fcd6808d4d0 0x7fcd6817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40666/0 (socket says 10.20.193.43:40666) 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd66ffd640 1 -- 10.20.193.43:0/2354814628 learned_addr learned my addr 10.20.193.43:0/2354814628 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110499471 0 0) 0x7fcd6808a690 con 0x7fcd6808d4d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): my global_id is 24882 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd54003610 con 0x7fcd6808d4d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714742376 0 0) 0x7fcd68088ae0 con 0x7fcd6808ddb0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): my global_id is 74456 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd6808a690 con 0x7fcd6808ddb0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228918071 0 0) 0x7fcd6808b910 con 0x7fcd6808d8d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient(hunting): my global_id is 84118 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd68088ae0 con 0x7fcd6808d8d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3111698996 0 0) 0x7fcd54003610 con 0x7fcd6808d4d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 >> v1:10.20.193.43:6790/0 conn(0x7fcd6808ddb0 legacy=0x7fcd6808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 >> v1:10.20.193.46:6789/0 conn(0x7fcd6808d8d0 legacy=0x7fcd6819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 monclient: found mon.noname-a 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd681a3ef0 con 0x7fcd6808d4d0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.529 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fcd50002df0 con 0x7fcd6808d4d0 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 5 monclient: authenticate success, global_id 24882 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: dump: 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd50003030 con 0x7fcd6808d4d0 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 1 -- 10.20.193.43:0/2354814628 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fcd50003470 con 0x7fcd6808d4d0 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd6d902640 4 set_mon_vals no callback set 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.523+0000 7fcd65ffb640 10 monclient: dump: 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 10 monclient: shutdown 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 -- 10.20.193.43:0/2354814628 >> v1:10.20.193.43:6789/0 conn(0x7fcd6808d4d0 legacy=0x7fcd6817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 -- 10.20.193.43:0/2354814628 shutdown_connections 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 -- 10.20.193.43:0/2354814628 >> 10.20.193.43:0/2354814628 conn(0x7fcd6808f480 msgr2=0x7fcd6808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 -- 10.20.193.43:0/2354814628 shutdown_connections 2026-02-21T01:31:33.530 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 -- 10.20.193.43:0/2354814628 wait complete. 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 10 monclient: build_initial_monmap 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 10 monclient: monmap: 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 librados: starting msgr at 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 librados: starting objecter 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 Processor -- start 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 -- start start 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 librados: setting wanted keys 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 1 librados: calling monclient init 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 10 monclient: init 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.524+0000 7fcd6d902640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient(hunting): picked mon.noname-b con 0x7fcd6808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient(hunting): picked mon.noname-c con 0x7fcd6808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient(hunting): picked mon.noname-a con 0x7fcd6808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd68106730 con 0x7fcd6808ddb0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd680571e0 con 0x7fcd6808d4d0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd68108800 con 0x7fcd6808d8d0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient(hunting): authenticate will time out at 825.231041s 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd667fc640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fcd6808d8d0 0x7fcd6818b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51026/0 (socket says 10.20.193.43:51026) 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd677fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fcd6808ddb0 0x7fcd6818cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40676/0 (socket says 10.20.193.43:40676) 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd667fc640 1 -- 10.20.193.43:0/2407421086 learned_addr learned my addr 10.20.193.43:0/2407421086 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 client.?.objecter ms_handle_connect 0x7fcd6808d8d0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 client.?.objecter ms_handle_connect 0x7fcd6808ddb0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115371446 0 0) 0x7fcd68106730 con 0x7fcd6808ddb0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): my global_id is 24885 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd38003610 con 0x7fcd6808ddb0 2026-02-21T01:31:33.531 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966050031 0 0) 0x7fcd68108800 con 0x7fcd6808d8d0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): _negotiate 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): my global_id is 74459 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd68106730 con 0x7fcd6808d8d0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2599829193 0 0) 0x7fcd38003610 con 0x7fcd6808ddb0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd68108800 con 0x7fcd6808ddb0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3794490272 0 0) 0x7fcd68106730 con 0x7fcd6808d8d0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd38003610 con 0x7fcd6808d8d0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fcd50003380 con 0x7fcd6808d8d0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): dump: 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fcd58003510 con 0x7fcd6808ddb0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient(hunting): dump: 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 client.?.objecter ms_handle_connect 0x7fcd6808d4d0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 398221704 0 0) 0x7fcd38003610 con 0x7fcd6808d8d0 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 >> v1:10.20.193.46:6789/0 conn(0x7fcd6808d4d0 legacy=0x7fcd6811bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.532 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 >> v1:10.20.193.43:6789/0 conn(0x7fcd6808ddb0 legacy=0x7fcd6818cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: _finish_hunting 0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 monclient: found mon.c 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6811c820 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: _finish_auth 0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: _check_auth_tickets 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 5 monclient: authenticate success, global_id 74459 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient: _renew_subs 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6805e190 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 client.74459.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient: _renew_subs 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcd68107000 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 1 librados: init done 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd50002fb0 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fcd50004c20 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 10 monclient: dump: 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd657fa640 4 set_mon_vals no callback set 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6811c640 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.525+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fcd500115a0 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.526+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(198..198 src has 1..198) ==== 4488+0+0 (unknown 136607979 0 0) 0x7fcd5004dfb0 con 0x7fcd6808d8d0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.526+0000 7fcd3ffff640 10 client.74459.objecter ms_dispatch2 0x7fcd68000b90 osd_map(198..198 src has 1..198) 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.526+0000 7fcd3ffff640 3 client.74459.objecter handle_osd_map got epochs [198,198] > 0 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.526+0000 7fcd3ffff640 3 client.74459.objecter handle_osd_map decoding full epoch 198 2026-02-21T01:31:33.533 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.526+0000 7fcd3ffff640 20 client.74459.objecter dump_active .. 0 homeless 2026-02-21T01:31:33.534 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.526+0000 7fcd66ffd640 10 monclient: get_auth_request con 0x7fcd3803e8b0 auth_method 0 2026-02-21T01:31:33.534 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.526+0000 7fcd3ffff640 10 client.74459.objecter ms_handle_connect 0x7fcd3803e8b0 2026-02-21T01:31:33.534 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.528+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fcd6811c640 con 0x7fcd6808d8d0 2026-02-21T01:31:33.534 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.528+0000 7fcd3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:33.534 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.528+0000 7fcd3ffff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:33.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.678+0000 7fcd6d902640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-21T01:31:33.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.678+0000 7fcd6d902640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-21T01:31:33.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.678+0000 7fcd6d902640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:31:33.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.678+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fcd6808edd0 con 0x7fcd6808d8d0 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=11,kv=10,logm=65} crc {auth=648695609,config=3140514009,health=138247344,kv=4247809061,logm=2192381598}) 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=12,kv=7,logm=65} crc {auth=2840094038,config=3140514009,health=267183875,kv=3318311719,logm=2067864392}) 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=11,kv=10,logm=65} crc {auth=648695609,config=3140514009,health=138247344,kv=4247809061,logm=2192381598}) 2026-02-21T01:31:33.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.678+0000 7fcd3ffff640 1 -- 10.20.193.43:0/2407421086 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fcd500176e0 con 0x7fcd6808d8d0 2026-02-21T01:31:33.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.678+0000 7fcd3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-21T01:31:33.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.678+0000 7fcd3ffff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=12,kv=10,logm=61} crc {auth=2179277978,config=3140514009,health=2367458740,kv=1200173230,logm=1025406767}) 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=512288336}) 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2287264526}) 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=512288336}) 2026-02-21T01:31:33.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3783388879}) 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 10 librados: watch_flush enter 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 10 librados: watch_flush exit 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 20 client.74459.objecter shutdown clearing up homeless session... 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 10 client.74459.objecter successfully canceled tick 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 >> v1:10.20.193.46:6812/860801619 conn(0x7fcd3803e8b0 legacy=0x7fcd3805ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 10 monclient: shutdown 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 >> v1:10.20.193.43:6790/0 conn(0x7fcd6808d8d0 legacy=0x7fcd6818b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 shutdown_connections 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 >> 10.20.193.43:0/2407421086 conn(0x7fcd6808f480 msgr2=0x7fcd680577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:33.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 shutdown_connections 2026-02-21T01:31:33.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2166953264}) 2026-02-21T01:31:33.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 1 -- 10.20.193.43:0/2407421086 wait complete. 2026-02-21T01:31:33.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2812747110}) 2026-02-21T01:31:33.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2166953264}) 2026-02-21T01:31:33.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2065446128}) 2026-02-21T01:31:33.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:33.679+0000 7fcd6d902640 1 librados: shutdown 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1316693814}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2109399934}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1316693814}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1039352632}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884751038}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3066906658}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884751038}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3658102829}) 2026-02-21T01:31:33.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364981759}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=719566421}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364981759}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.680+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2825886639}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635737767}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1228658172}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635737767}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2446066176}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742918634}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2830155013}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742918634}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1171732482}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1793687065}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1230569720}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1793687065}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3289334822}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3812186745}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2122732874}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3812186745}) 2026-02-21T01:31:33.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.681+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=803514970}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.682+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.682+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033561769}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.682+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4048681401}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.682+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.682+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033561769}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.682+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3335491419}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3306197156}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4090346088}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3306197156}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4143484837}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699250688}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3239341514}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=699250688}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3510336050}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2663201233}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512726422}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2663201233}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1103484827}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271578514}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2806785902}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271578514}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.683+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2973606081}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914079595}) 2026-02-21T01:31:33.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2523763141}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3914079595}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1828595862}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3318393492}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3531060393}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3318393492}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3330955918}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=285783223}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1396586985}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=285783223}) 2026-02-21T01:31:33.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.684+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=286389893}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4234020438}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1984053378}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4234020438}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=646433911}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451747907}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=648868777}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451747907}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4081720227}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=80312288}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=27606882}) 2026-02-21T01:31:33.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=80312288}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.685+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2380273564}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=11} crc {logm=2844722491,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=1663343525,mon_config_key=1389493985,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=4279616755,osd_pg_creating=245755951,osd_snap=1564315534,osdmap=2322113979}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=18,osdmap=9} crc {logm=3795754815,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=266438641,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=245755951,osd_snap=4273202816,osdmap=3602163105}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=11} crc {logm=2844722491,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=1663343525,mon_config_key=1389493985,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=4279616755,osd_pg_creating=245755951,osd_snap=1564315534,osdmap=2322113979}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=18,osdmap=9} crc {logm=1410447438,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=266438641,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=935146538,osd_metadata=2108339561,osd_pg_creating=245755951,osd_snap=3709060478,osdmap=3747496429}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2385171683}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=679214248}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2385171683}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.686+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=144320052}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2608040429}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2417356095}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2608040429}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=337014187}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=87} crc {osdmap=3066458628}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=89} crc {osdmap=1883063120}) 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:31:33.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=87} crc {osdmap=3066458628}) 2026-02-21T01:31:33.690 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:31:33.687+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=87} crc {osdmap=1240173963}) 2026-02-21T01:31:33.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-21T01:31:34.691 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:31:34.692 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.759+0000 7f21629eb640 10 monclient: get_monmap_and_config 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.759+0000 7f21629eb640 10 monclient: build_initial_monmap 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.759+0000 7f21629eb640 10 monclient: monmap: 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:34.761149+0000 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:34.761149+0000 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:34.761 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 1 Processor -- start 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 1 -- start start 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient: init 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient(hunting): picked mon.noname-c con 0x7f215c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient(hunting): picked mon.noname-a con 0x7f215c08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient(hunting): picked mon.noname-b con 0x7f215c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c08a690 con 0x7f215c08d4d0 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c08b910 con 0x7f215c08ddb0 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c088ae0 con 0x7f215c08d8d0 2026-02-21T01:31:34.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 10 monclient(hunting): authenticate will time out at 826.466527s 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215b7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f215c08d4d0 0x7f215c17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40692/0 (socket says 10.20.193.43:40692) 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215b7fe640 1 -- 10.20.193.43:0/3383825196 learned_addr learned my addr 10.20.193.43:0/3383825196 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f2160f61640 1 --1- 10.20.193.43:0/3383825196 >> v1:10.20.193.43:6790/0 conn(0x7f215c08d8d0 0x7f215c19f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51034/0 (socket says 10.20.193.43:51034) 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979977642 0 0) 0x7f215c08a690 con 0x7f215c08d4d0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): my global_id is 24888 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2140003610 con 0x7f215c08d4d0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920223415 0 0) 0x7f215c088ae0 con 0x7f215c08d8d0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): my global_id is 74465 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f215c08a690 con 0x7f215c08d8d0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849330497 0 0) 0x7f215c08b910 con 0x7f215c08ddb0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient(hunting): my global_id is 84127 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f215c088ae0 con 0x7f215c08ddb0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 957809550 0 0) 0x7f2140003610 con 0x7f215c08d4d0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 >> v1:10.20.193.43:6790/0 conn(0x7f215c08d8d0 legacy=0x7f215c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 >> v1:10.20.193.46:6789/0 conn(0x7f215c08ddb0 legacy=0x7f215c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient: _finish_hunting 0 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 monclient: found mon.noname-a 2026-02-21T01:31:34.766 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c1a3ef0 con 0x7f215c08d4d0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient: _finish_auth 0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient: _check_auth_tickets 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f214c002df0 con 0x7f215c08d4d0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 5 monclient: authenticate success, global_id 24888 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f21629eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.760+0000 7f215affd640 10 monclient: dump: 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f214c003000 con 0x7f215c08d4d0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f215affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f215affd640 1 -- 10.20.193.43:0/3383825196 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f214c003440 con 0x7f215c08d4d0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f215affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f215affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f215affd640 10 monclient: dump: 2026-02-21T01:31:34.767 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 4 set_mon_vals no callback set 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 10 monclient: shutdown 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 -- 10.20.193.43:0/3383825196 >> v1:10.20.193.43:6789/0 conn(0x7f215c08d4d0 legacy=0x7f215c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 -- 10.20.193.43:0/3383825196 shutdown_connections 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 -- 10.20.193.43:0/3383825196 >> 10.20.193.43:0/3383825196 conn(0x7f215c08f480 msgr2=0x7f215c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 -- 10.20.193.43:0/3383825196 shutdown_connections 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 -- 10.20.193.43:0/3383825196 wait complete. 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 10 monclient: build_initial_monmap 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 10 monclient: monmap: 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:34.768 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 librados: starting msgr at 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 librados: starting objecter 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 Processor -- start 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 -- start start 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 librados: setting wanted keys 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 1 librados: calling monclient init 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.761+0000 7f21629eb640 10 monclient: init 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient(hunting): picked mon.noname-a con 0x7f215c08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient(hunting): picked mon.noname-c con 0x7f215c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient(hunting): picked mon.noname-b con 0x7f215c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c088000 con 0x7f215c08d4d0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c05e1b0 con 0x7f215c08ddb0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c0878e0 con 0x7f215c08d8d0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient(hunting): authenticate will time out at 826.468180s 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f215b7fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f215c08d8d0 0x7f215c086c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51044/0 (socket says 10.20.193.43:51044) 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f215bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f215c08d4d0 0x7f215c086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40694/0 (socket says 10.20.193.43:40694) 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f215b7fe640 1 -- 10.20.193.43:0/4217745550 learned_addr learned my addr 10.20.193.43:0/4217745550 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 client.?.objecter ms_handle_connect 0x7f215c08d8d0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 client.?.objecter ms_handle_connect 0x7f215c08d4d0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334473020 0 0) 0x7f215c088000 con 0x7f215c08d4d0 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:34.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): my global_id is 24891 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f212c003610 con 0x7f215c08d4d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190920351 0 0) 0x7f215c0878e0 con 0x7f215c08d8d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): my global_id is 74468 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f215c088000 con 0x7f215c08d8d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 72812489 0 0) 0x7f212c003610 con 0x7f215c08d4d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f215c0878e0 con 0x7f215c08d4d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f21480030b0 con 0x7f215c08d4d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): dump: 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1987277361 0 0) 0x7f215c088000 con 0x7f215c08d8d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f212c003610 con 0x7f215c08d8d0 2026-02-21T01:31:34.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f214c003350 con 0x7f215c08d8d0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient(hunting): dump: 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 272931658 0 0) 0x7f215c0878e0 con 0x7f215c08d4d0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 >> v1:10.20.193.43:6790/0 conn(0x7f215c08d8d0 legacy=0x7f215c086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 >> v1:10.20.193.46:6789/0 conn(0x7f215c08ddb0 legacy=0x7f215c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 monclient: found mon.a 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c10dbc0 con 0x7f215c08d4d0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: _finish_auth 0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 5 monclient: authenticate success, global_id 24891 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient: _renew_subs 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f215c10d320 con 0x7f215c08d4d0 2026-02-21T01:31:34.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 client.24891.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient: _renew_subs 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21480034e0 con 0x7f215c08d4d0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f215c087560 con 0x7f215c08d4d0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 1 librados: init done 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2148003b50 con 0x7f215c08d4d0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f215a7fc640 4 set_mon_vals no callback set 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f2158ff9640 10 monclient: dump: 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.762+0000 7f21629eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f21629eb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f21629eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c08edd0 con 0x7f215c08d4d0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f2148003cf0 con 0x7f215c08d4d0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 4649+0+0 (unknown 682319743 0 0) 0x7f214804e240 con 0x7f215c08d4d0 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f2158ff9640 10 client.24891.objecter ms_dispatch2 0x7f215c000b90 osd_map(199..199 src has 1..199) 2026-02-21T01:31:34.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f2158ff9640 3 client.24891.objecter handle_osd_map got epochs [199,199] > 0 2026-02-21T01:31:34.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f2158ff9640 3 client.24891.objecter handle_osd_map decoding full epoch 199 2026-02-21T01:31:34.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f2158ff9640 20 client.24891.objecter dump_active .. 0 homeless 2026-02-21T01:31:34.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f215b7fe640 10 monclient: get_auth_request con 0x7f212c03e9a0 auth_method 0 2026-02-21T01:31:34.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.763+0000 7f2158ff9640 10 client.24891.objecter ms_handle_connect 0x7f212c03e9a0 2026-02-21T01:31:34.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.765+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f21480176f0 con 0x7f215c08d4d0 2026-02-21T01:31:34.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.765+0000 7f2158ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:34.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.765+0000 7f2158ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:34.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.917+0000 7f21629eb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:31:34.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.917+0000 7f21629eb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:34.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.917+0000 7f21629eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:34.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.917+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f215c1a10d0 con 0x7f215c08d4d0 2026-02-21T01:31:34.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.917+0000 7f2158ff9640 1 -- 10.20.193.43:0/4217745550 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 914757054) 0x7f214801c6d0 con 0x7f215c08d4d0 2026-02-21T01:31:34.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.917+0000 7f2158ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:34.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.917+0000 7f2158ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:34.920 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:31:34.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 10 librados: watch_flush enter 2026-02-21T01:31:34.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 10 librados: watch_flush exit 2026-02-21T01:31:34.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 20 client.24891.objecter shutdown clearing up homeless session... 2026-02-21T01:31:34.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 10 client.24891.objecter successfully canceled tick 2026-02-21T01:31:34.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 >> v1:10.20.193.46:6812/860801619 conn(0x7f212c03e9a0 legacy=0x7f212c05ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:34.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 10 monclient: shutdown 2026-02-21T01:31:34.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:34.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 >> v1:10.20.193.43:6789/0 conn(0x7f215c08d4d0 legacy=0x7f215c086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:34.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 shutdown_connections 2026-02-21T01:31:34.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 >> 10.20.193.43:0/4217745550 conn(0x7f215c08f480 msgr2=0x7f215c1a3410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:34.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 shutdown_connections 2026-02-21T01:31:34.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 1 -- 10.20.193.43:0/4217745550 wait complete. 2026-02-21T01:31:34.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.918+0000 7f21629eb640 1 librados: shutdown 2026-02-21T01:31:34.928 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:31:34.928 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-21T01:31:34.928 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:31:34.928 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 10 monclient: get_monmap_and_config 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 10 monclient: monmap: 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:34.995676+0000 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:34.995676+0000 2026-02-21T01:31:35.008 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 1 Processor -- start 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 1 -- start start 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 10 monclient: init 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.994+0000 7fba1295c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 10 monclient(hunting): picked mon.noname-a con 0x7fba0c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 10 monclient(hunting): picked mon.noname-b con 0x7fba0c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 10 monclient(hunting): picked mon.noname-c con 0x7fba0c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c08a690 con 0x7fba0c08ddb0 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c08b910 con 0x7fba0c08d8d0 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c088ae0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 10 monclient(hunting): authenticate will time out at 826.701075s 2026-02-21T01:31:35.010 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fba0c08ddb0 0x7fba0c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40698/0 (socket says 10.20.193.43:40698) 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0bfff640 1 -- 10.20.193.43:0/1122543374 learned_addr learned my addr 10.20.193.43:0/1122543374 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426431603 0 0) 0x7fba0c08a690 con 0x7fba0c08ddb0 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): my global_id is 24894 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9f0003610 con 0x7fba0c08ddb0 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429340378 0 0) 0x7fba0c088ae0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.011 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient(hunting): my global_id is 74471 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c08a690 con 0x7fba0c08d4d0 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 752014062 0 0) 0x7fb9f0003610 con 0x7fba0c08ddb0 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 >> v1:10.20.193.43:6790/0 conn(0x7fba0c08d4d0 legacy=0x7fba0c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 >> v1:10.20.193.46:6789/0 conn(0x7fba0c08d8d0 legacy=0x7fba0c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 monclient: found mon.noname-a 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.012 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c1a3ef0 con 0x7fba0c08ddb0 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb9f8002df0 con 0x7fba0c08ddb0 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 5 monclient: authenticate success, global_id 24894 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:35.013 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: dump: 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.014 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb9f80030f0 con 0x7fba0c08ddb0 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 1 -- 10.20.193.43:0/1122543374 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb9f8003530 con 0x7fba0c08ddb0 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 4 set_mon_vals no callback set 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba0affd640 10 monclient: dump: 2026-02-21T01:31:35.015 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 10 monclient: shutdown 2026-02-21T01:31:35.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- 10.20.193.43:0/1122543374 >> v1:10.20.193.43:6789/0 conn(0x7fba0c08ddb0 legacy=0x7fba0c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- 10.20.193.43:0/1122543374 shutdown_connections 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- 10.20.193.43:0/1122543374 >> 10.20.193.43:0/1122543374 conn(0x7fba0c08f480 msgr2=0x7fba0c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- 10.20.193.43:0/1122543374 shutdown_connections 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.995+0000 7fba1295c640 1 -- 10.20.193.43:0/1122543374 wait complete. 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient: monmap: 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.017 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 librados: starting msgr at 2026-02-21T01:31:35.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 librados: starting objecter 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 Processor -- start 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 -- start start 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 librados: setting wanted keys 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 librados: calling monclient init 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient: init 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient(hunting): picked mon.noname-a con 0x7fba0c08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient(hunting): picked mon.noname-b con 0x7fba0c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient(hunting): picked mon.noname-c con 0x7fba0c08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c10a7c0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c10aaa0 con 0x7fba0c08d8d0 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c0572c0 con 0x7fba0c08ddb0 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba1295c640 10 monclient(hunting): authenticate will time out at 826.702670s 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba0bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fba0c08d4d0 0x7fba0c086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40708/0 (socket says 10.20.193.43:40708) 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba0bfff640 1 -- 10.20.193.43:0/1240127316 learned_addr learned my addr 10.20.193.43:0/1240127316 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 client.?.objecter ms_handle_connect 0x7fba0c08d4d0 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 client.?.objecter ms_handle_connect 0x7fba0c08ddb0 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414588647 0 0) 0x7fba0c10a7c0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): my global_id is 24897 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9dc003610 con 0x7fba0c08d4d0 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862512991 0 0) 0x7fba0c0572c0 con 0x7fba0c08ddb0 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): my global_id is 74474 2026-02-21T01:31:35.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c10a7c0 con 0x7fba0c08ddb0 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 291208947 0 0) 0x7fb9dc003610 con 0x7fba0c08d4d0 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba0c0572c0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb9f8002db0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): dump: 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.022 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3828687115 0 0) 0x7fba0c10a7c0 con 0x7fba0c08ddb0 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9dc003610 con 0x7fba0c08ddb0 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fba00003390 con 0x7fba0c08ddb0 2026-02-21T01:31:35.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.996+0000 7fba08ff9640 10 monclient(hunting): dump: 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.024 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 234391436 0 0) 0x7fba0c0572c0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.43:6790/0 conn(0x7fba0c08ddb0 legacy=0x7fba0c18ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.46:6789/0 conn(0x7fba0c08d8d0 legacy=0x7fba0c086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 monclient: found mon.a 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c05e1b0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 client.?.objecter ms_handle_connect 0x7fba0c08d8d0 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 5 monclient: authenticate success, global_id 24897 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 10 monclient: _renew_subs 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c05c4f0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 10 client.24897.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 10 monclient: _renew_subs 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fba0c087bf0 con 0x7fba0c08d4d0 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 1 librados: init done 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb9f8002940 con 0x7fba0c08d4d0 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb9f8004d90 con 0x7fba0c08d4d0 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: dump: 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.027 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba0a7fc640 4 set_mon_vals no callback set 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba0c08edb0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 client.24897.objecter ms_handle_connect 0x7fba0c1a10d0 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 client.24897.objecter resend_mon_ops 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203941638 0 0) 0x7fba0c08edb0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient(hunting): my global_id is 24900 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c0572c0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2512578905 0 0) 0x7fba0c0572c0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba0c08edb0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb9fc002f10 con 0x7fba0c1a10d0 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 monclient: dump: 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.029 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fb9f8011710 con 0x7fba0c08d4d0 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 4649+0+0 (unknown 682319743 0 0) 0x7fb9f804e080 con 0x7fba0c08d4d0 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 10 client.24897.objecter ms_dispatch2 0x7fba0c000b90 osd_map(199..199 src has 1..199) 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 3 client.24897.objecter handle_osd_map got epochs [199,199] > 0 2026-02-21T01:31:35.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.997+0000 7fba08ff9640 3 client.24897.objecter handle_osd_map decoding full epoch 199 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 20 client.24897.objecter dump_active .. 0 homeless 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2592588347 0 0) 0x7fba0c08edb0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba0c0008d0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba10ed2640 10 monclient: get_auth_request con 0x7fb9dc03ea50 auth_method 0 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb9fc0031d0 con 0x7fba0c1a10d0 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.43:6789/0 conn(0x7fba0c1a10d0 legacy=0x7fba0c11ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.43:6789/0 conn(0x7fba0c1a10d0 legacy=0x7fba0c11ebc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:34.998+0000 7fba08ff9640 10 client.24897.objecter ms_handle_connect 0x7fb9dc03ea50 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba1295c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba0c05bd70 con 0x7fba0c04ca30 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 client.24897.objecter ms_handle_connect 0x7fba0c04ca30 2026-02-21T01:31:35.031 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 client.24897.objecter resend_mon_ops 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181762473 0 0) 0x7fba0c05bd70 con 0x7fba0c04ca30 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 monclient(hunting): my global_id is 24903 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c08edb0 con 0x7fba0c04ca30 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3764044522 0 0) 0x7fba0c08edb0 con 0x7fba0c04ca30 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba0c05bd70 con 0x7fba0c04ca30 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb9fc0038a0 con 0x7fba0c04ca30 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.001+0000 7fba08ff9640 10 monclient: dump: 2026-02-21T01:31:35.032 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 981705618 0 0) 0x7fba0c05bd70 con 0x7fba0c04ca30 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba0c04ce00 con 0x7fba0c04ca30 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4318 (unknown 0 0 2509830329) 0x7fb9fc003970 con 0x7fba0c04ca30 2026-02-21T01:31:35.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba08ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:35.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba08ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:35.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.43:6789/0 conn(0x7fba0c04ca30 legacy=0x7fba0c191480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.034 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba08ff9640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.43:6789/0 conn(0x7fba0c04ca30 legacy=0x7fba0c191480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:35.034 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:35.034 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:35.034 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:35.034 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 20, 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 230633, 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 1, 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.035 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.036 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.037 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:35.038 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.039 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.040 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:35.041 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.042 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.043 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.044 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:31:35.045 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.045 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.045 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.045 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:35.045 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:35.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 10 librados: watch_flush enter 2026-02-21T01:31:35.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 10 librados: watch_flush exit 2026-02-21T01:31:35.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 20 client.24897.objecter shutdown clearing up homeless session... 2026-02-21T01:31:35.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 10 client.24897.objecter successfully canceled tick 2026-02-21T01:31:35.046 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.46:6812/860801619 conn(0x7fb9dc03ea50 legacy=0x7fb9dc05ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 10 monclient: shutdown 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 >> v1:10.20.193.43:6789/0 conn(0x7fba0c08d4d0 legacy=0x7fba0c086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba10ed2640 1 -- 10.20.193.43:0/1240127316 reap_dead start 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba10ed2640 1 -- 10.20.193.43:0/1240127316 reap_dead start 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 shutdown_connections 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 >> 10.20.193.43:0/1240127316 conn(0x7fba0c08f480 msgr2=0x7fba0c1a2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 shutdown_connections 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 1 -- 10.20.193.43:0/1240127316 wait complete. 2026-02-21T01:31:35.047 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.002+0000 7fba1295c640 1 librados: shutdown 2026-02-21T01:31:35.047 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:31:35.047 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:31:35.048 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.113+0000 7fd4a2e32640 10 monclient: get_monmap_and_config 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.113+0000 7fd4a2e32640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.113+0000 7fd4a2e32640 10 monclient: monmap: 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:35.114908+0000 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:35.114908+0000 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.113+0000 7fd4a2e32640 1 Processor -- start 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.113+0000 7fd4a2e32640 1 -- start start 2026-02-21T01:31:35.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.113+0000 7fd4a2e32640 10 monclient: init 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient(hunting): picked mon.noname-b con 0x7fd49c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c08a690 con 0x7fd49c08ddb0 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c08b910 con 0x7fd49c08d4d0 2026-02-21T01:31:35.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c088ae0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient(hunting): authenticate will time out at 826.820326s 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a0ba7640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd49c08ddb0 0x7fd49c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40732/0 (socket says 10.20.193.43:40732) 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a0ba7640 1 -- 10.20.193.43:0/1644425563 learned_addr learned my addr 10.20.193.43:0/1644425563 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a13a8640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fd49c08d8d0 0x7fd49c19f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51066/0 (socket says 10.20.193.43:51066) 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221646653 0 0) 0x7fd49c088ae0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): my global_id is 74477 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd488003610 con 0x7fd49c08d8d0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131349784 0 0) 0x7fd49c08a690 con 0x7fd49c08ddb0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient(hunting): my global_id is 24906 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c088ae0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1225785637 0 0) 0x7fd488003610 con 0x7fd49c08d8d0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 >> v1:10.20.193.46:6789/0 conn(0x7fd49c08d4d0 legacy=0x7fd49c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 >> v1:10.20.193.43:6789/0 conn(0x7fd49c08ddb0 legacy=0x7fd49c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 monclient: found mon.noname-b 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c1a3ef0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.120 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd498003170 con 0x7fd49c08d8d0 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: dump: 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 5 monclient: authenticate success, global_id 74477 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd498003430 con 0x7fd49c08d8d0 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 1 -- 10.20.193.43:0/1644425563 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd498003870 con 0x7fd49c08d8d0 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4a2e32640 4 set_mon_vals no callback set 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.114+0000 7fd4937fe640 10 monclient: dump: 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.121 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient: shutdown 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- 10.20.193.43:0/1644425563 >> v1:10.20.193.43:6790/0 conn(0x7fd49c08d8d0 legacy=0x7fd49c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- 10.20.193.43:0/1644425563 shutdown_connections 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- 10.20.193.43:0/1644425563 >> 10.20.193.43:0/1644425563 conn(0x7fd49c08f480 msgr2=0x7fd49c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- 10.20.193.43:0/1644425563 shutdown_connections 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- 10.20.193.43:0/1644425563 wait complete. 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient: monmap: 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 librados: starting msgr at 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 librados: starting objecter 2026-02-21T01:31:35.122 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 Processor -- start 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- start start 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 librados: setting wanted keys 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 librados: calling monclient init 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient: init 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient(hunting): picked mon.noname-b con 0x7fd49c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c05e1b0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c1064d0 con 0x7fd49c08d4d0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c0574f0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.115+0000 7fd4a2e32640 10 monclient(hunting): authenticate will time out at 826.821975s 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a13a8640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd49c08ddb0 0x7fd49c19b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40746/0 (socket says 10.20.193.43:40746) 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a13a8640 1 -- 10.20.193.43:0/3436167922 learned_addr learned my addr 10.20.193.43:0/3436167922 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd493fff640 1 --1- 10.20.193.43:0/3436167922 >> v1:10.20.193.43:6790/0 conn(0x7fd49c08d8d0 0x7fd49c105dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51072/0 (socket says 10.20.193.43:51072) 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.?.objecter ms_handle_connect 0x7fd49c08ddb0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.?.objecter ms_handle_connect 0x7fd49c08d8d0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595025999 0 0) 0x7fd49c05e1b0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): my global_id is 24909 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd46c003610 con 0x7fd49c08ddb0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164836529 0 0) 0x7fd49c0574f0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): my global_id is 74480 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c05e1b0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 699091335 0 0) 0x7fd46c003610 con 0x7fd49c08ddb0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49c0574f0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd498003130 con 0x7fd49c08ddb0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): dump: 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 96537992 0 0) 0x7fd49c05e1b0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd46c003610 con 0x7fd49c08d8d0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd4840030d0 con 0x7fd49c08d8d0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): dump: 2026-02-21T01:31:35.124 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.?.objecter ms_handle_connect 0x7fd49c08d4d0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 723086679 0 0) 0x7fd49c0574f0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.43:6790/0 conn(0x7fd49c08d8d0 legacy=0x7fd49c105dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.46:6789/0 conn(0x7fd49c08d4d0 legacy=0x7fd49c1056b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 monclient: found mon.a 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c106fe0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 5 monclient: authenticate success, global_id 24909 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 10 monclient: _renew_subs 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c109340 con 0x7fd49c08ddb0 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 10 client.24909.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 10 monclient: _renew_subs 2026-02-21T01:31:35.125 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd49c12ae80 con 0x7fd49c08ddb0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 1 librados: init done 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd498004fa0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd4980052f0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd492ffd640 4 set_mon_vals no callback set 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient: dump: 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd49c08edd0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.24909.objecter ms_handle_connect 0x7fd49c1a10d0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 client.24909.objecter resend_mon_ops 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887475146 0 0) 0x7fd49c08edd0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 10 monclient(hunting): my global_id is 74483 2026-02-21T01:31:35.126 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.116+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c0574f0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fd498005510 con 0x7fd49c08ddb0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 4649+0+0 (unknown 682319743 0 0) 0x7fd49804e4f0 con 0x7fd49c08ddb0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 10 client.24909.objecter ms_dispatch2 0x7fd49c000b90 osd_map(199..199 src has 1..199) 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 3 client.24909.objecter handle_osd_map got epochs [199,199] > 0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 3 client.24909.objecter handle_osd_map decoding full epoch 199 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 20 client.24909.objecter dump_active .. 0 homeless 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 716777732 0 0) 0x7fd49c0574f0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49c08edd0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd48c002bc0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 10 monclient: dump: 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2053349258 0 0) 0x7fd49c08edd0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd49c0008d0 con 0x7fd49c1a10d0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd493fff640 10 monclient: get_auth_request con 0x7fd46c03e9e0 auth_method 0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd48c002c80 con 0x7fd49c1a10d0 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.127 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:35.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.43:6790/0 conn(0x7fd49c1a10d0 legacy=0x7fd49c0584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.43:6790/0 conn(0x7fd49c1a10d0 legacy=0x7fd49c0584b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:35.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.117+0000 7fd4917fa640 10 client.24909.objecter ms_handle_connect 0x7fd46c03e9e0 2026-02-21T01:31:35.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.120+0000 7fd4a2e32640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:35.128 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.120+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd49c0592d0 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.120+0000 7fd4917fa640 10 client.24909.objecter ms_handle_connect 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.120+0000 7fd4917fa640 10 client.24909.objecter resend_mon_ops 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153382860 0 0) 0x7fd49c0592d0 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient(hunting): my global_id is 74486 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c08edd0 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 730313415 0 0) 0x7fd49c08edd0 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49c0592d0 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd48c003540 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient: dump: 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2570949795 0 0) 0x7fd49c0592d0 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd49c107cb0 con 0x7fd49c12a080 2026-02-21T01:31:35.129 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4483 (unknown 0 0 3082674951) 0x7fd48c006a30 con 0x7fd49c12a080 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.43:6790/0 conn(0x7fd49c12a080 legacy=0x7fd49c058bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4917fa640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.43:6790/0 conn(0x7fd49c12a080 legacy=0x7fd49c058bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 20, 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 108860, 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.130 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.131 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.132 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:35.133 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:35.134 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.135 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:35.136 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 10 librados: watch_flush enter 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 10 librados: watch_flush exit 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 20 client.24909.objecter shutdown clearing up homeless session... 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 10 client.24909.objecter successfully canceled tick 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.46:6812/860801619 conn(0x7fd46c03e9e0 legacy=0x7fd46c05ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 10 monclient: shutdown 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 >> v1:10.20.193.43:6789/0 conn(0x7fd49c08ddb0 legacy=0x7fd49c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a13a8640 1 -- 10.20.193.43:0/3436167922 reap_dead start 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a13a8640 1 -- 10.20.193.43:0/3436167922 reap_dead start 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 shutdown_connections 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 >> 10.20.193.43:0/3436167922 conn(0x7fd49c08f480 msgr2=0x7fd49c057720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 shutdown_connections 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 1 -- 10.20.193.43:0/3436167922 wait complete. 2026-02-21T01:31:35.137 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.121+0000 7fd4a2e32640 1 librados: shutdown 2026-02-21T01:31:35.137 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:31:35.138 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:31:35.138 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.203+0000 7f774cb5c640 10 monclient: get_monmap_and_config 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.203+0000 7f774cb5c640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.203+0000 7f774cb5c640 10 monclient: monmap: 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:35.204682+0000 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:35.204682+0000 2026-02-21T01:31:35.204 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.205 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.205 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.205 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:35.205 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:35.205 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.203+0000 7f774cb5c640 1 Processor -- start 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.203+0000 7f774cb5c640 1 -- start start 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.203+0000 7f774cb5c640 10 monclient: init 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient(hunting): picked mon.noname-c con 0x7f774808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient(hunting): picked mon.noname-b con 0x7f774808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient(hunting): picked mon.noname-a con 0x7f774808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774808a690 con 0x7f774808d8d0 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774808b910 con 0x7f774808ddb0 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7748088ae0 con 0x7f774808d4d0 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient(hunting): authenticate will time out at 826.910111s 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745d74640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f774808d4d0 0x7f774817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51102/0 (socket says 10.20.193.43:51102) 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7746d76640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f774808d8d0 0x7f774819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40754/0 (socket says 10.20.193.43:40754) 2026-02-21T01:31:35.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745d74640 1 -- 10.20.193.43:0/1760802436 learned_addr learned my addr 10.20.193.43:0/1760802436 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2948753829 0 0) 0x7f7748088ae0 con 0x7f774808d4d0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): my global_id is 74489 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7734003610 con 0x7f774808d4d0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844274047 0 0) 0x7f774808a690 con 0x7f774808d8d0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient(hunting): my global_id is 24912 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7748088ae0 con 0x7f774808d8d0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3197818951 0 0) 0x7f7734003610 con 0x7f774808d4d0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 >> v1:10.20.193.46:6789/0 conn(0x7f774808ddb0 legacy=0x7f774808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 >> v1:10.20.193.43:6789/0 conn(0x7f774808d8d0 legacy=0x7f774819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 monclient: found mon.noname-b 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77481a3ef0 con 0x7f774808d4d0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7730002df0 con 0x7f774808d4d0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 5 monclient: authenticate success, global_id 74489 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: dump: 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.207 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7730003000 con 0x7f774808d4d0 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 1 -- 10.20.193.43:0/1760802436 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7730003440 con 0x7f774808d4d0 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f7745573640 10 monclient: dump: 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 4 set_mon_vals no callback set 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 10 monclient: shutdown 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- 10.20.193.43:0/1760802436 >> v1:10.20.193.43:6790/0 conn(0x7f774808d4d0 legacy=0x7f774817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- 10.20.193.43:0/1760802436 shutdown_connections 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- 10.20.193.43:0/1760802436 >> 10.20.193.43:0/1760802436 conn(0x7f774808f480 msgr2=0x7f774808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- 10.20.193.43:0/1760802436 shutdown_connections 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.204+0000 7f774cb5c640 1 -- 10.20.193.43:0/1760802436 wait complete. 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient: monmap: 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:35.208 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 librados: starting msgr at 2026-02-21T01:31:35.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 librados: starting objecter 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 Processor -- start 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 -- start start 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 librados: setting wanted keys 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 librados: calling monclient init 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient: init 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient(hunting): picked mon.noname-c con 0x7f774808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient(hunting): picked mon.noname-a con 0x7f774808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient(hunting): picked mon.noname-b con 0x7f774808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774805cca0 con 0x7f774808d8d0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774805e1b0 con 0x7f774808ddb0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77481288a0 con 0x7f774808d4d0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f774cb5c640 10 monclient(hunting): authenticate will time out at 826.911780s 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f7746575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f774808d4d0 0x7f7748112af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:51106/0 (socket says 10.20.193.43:51106) 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f7746575640 1 -- 10.20.193.43:0/2619874336 learned_addr learned my addr 10.20.193.43:0/2619874336 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 client.?.objecter ms_handle_connect 0x7f774808d8d0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 client.?.objecter ms_handle_connect 0x7f774808d4d0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597177595 0 0) 0x7f77481a3ef0 con 0x7f774808d8d0 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): my global_id is 24915 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7714003610 con 0x7f774808d8d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060532786 0 0) 0x7f77481288a0 con 0x7f774808d4d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 10 monclient(hunting): my global_id is 74492 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.205+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77481a3ef0 con 0x7f774808d4d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 696422790 0 0) 0x7f7714003610 con 0x7f774808d8d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77481288a0 con 0x7f774808d8d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7730003350 con 0x7f774808d8d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): dump: 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2819551915 0 0) 0x7f77481a3ef0 con 0x7f774808d4d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7714003610 con 0x7f774808d4d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f773c0030c0 con 0x7f774808d4d0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): dump: 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.213 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4233293297 0 0) 0x7f77481288a0 con 0x7f774808d8d0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.43:6790/0 conn(0x7f774808d4d0 legacy=0x7f7748112af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.46:6789/0 conn(0x7f774808ddb0 legacy=0x7f774819c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 monclient: found mon.a 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7748128b80 con 0x7f774808d8d0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 5 monclient: authenticate success, global_id 24915 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 10 monclient: _renew_subs 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7748127660 con 0x7f774808d8d0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 10 client.24915.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 10 monclient: _renew_subs 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7748087780 con 0x7f774808d8d0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 1 librados: init done 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7730002790 con 0x7f774808d8d0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f7730004e80 con 0x7f774808d8d0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient: dump: 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f7744d72640 4 set_mon_vals no callback set 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f774808edb0 con 0x7f77481a10d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f7730011800 con 0x7f774808d8d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 client.24915.objecter ms_handle_connect 0x7f77481a10d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 client.24915.objecter resend_mon_ops 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 4649+0+0 (unknown 682319743 0 0) 0x7f773004e0d0 con 0x7f774808d8d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 client.24915.objecter ms_dispatch2 0x7f7748000b90 osd_map(199..199 src has 1..199) 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 3 client.24915.objecter handle_osd_map got epochs [199,199] > 0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 3 client.24915.objecter handle_osd_map decoding full epoch 199 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 20 client.24915.objecter dump_active .. 0 homeless 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617528734 0 0) 0x7f774808edb0 con 0x7f77481a10d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.206+0000 7f772effd640 10 monclient(hunting): my global_id is 84145 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77481288a0 con 0x7f77481a10d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f7746d76640 10 monclient: get_auth_request con 0x7f771403e930 auth_method 0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 501528308 0 0) 0x7f77481288a0 con 0x7f77481a10d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f774808edb0 con 0x7f77481a10d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f773c0037c0 con 0x7f77481a10d0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 10 monclient: dump: 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.215 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3459020209 0 0) 0x7f774808edb0 con 0x7f77481a10d0 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7748087a70 con 0x7f77481a10d0 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 10 client.24915.objecter ms_handle_connect 0x7f771403e930 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f773c0038e0 con 0x7f77481a10d0 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.46:6789/0 conn(0x7f77481a10d0 legacy=0x7f774805a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.207+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.46:6789/0 conn(0x7f77481a10d0 legacy=0x7f774805a3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.210+0000 7f774cb5c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:35.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.210+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7748054ff0 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 client.24915.objecter ms_handle_connect 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 client.24915.objecter resend_mon_ops 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114175472 0 0) 0x7f7748054ff0 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient(hunting): my global_id is 84148 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f774808edb0 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 539776742 0 0) 0x7f774808edb0 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7748054ff0 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f773c003ff0 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient: dump: 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2266484619 0 0) 0x7f7748054ff0 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7748113600 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4147 (unknown 0 0 1790053187) 0x7f773c004070 con 0x7f7748113200 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:35.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.46:6789/0 conn(0x7f7748113200 legacy=0x7f774804ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f772effd640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.46:6789/0 conn(0x7f7748113200 legacy=0x7f774804ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 20, 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 2228, 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.218 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:35.219 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.220 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.221 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:35.222 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f774cb5c640 10 librados: watch_flush enter 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f774cb5c640 10 librados: watch_flush exit 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f774cb5c640 20 client.24915.objecter shutdown clearing up homeless session... 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.211+0000 7f774cb5c640 10 client.24915.objecter successfully canceled tick 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.46:6812/860801619 conn(0x7f771403e930 legacy=0x7f771405ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 10 monclient: shutdown 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 >> v1:10.20.193.43:6789/0 conn(0x7f774808d8d0 legacy=0x7f774819a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f7746d76640 1 -- 10.20.193.43:0/2619874336 reap_dead start 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f7746d76640 1 -- 10.20.193.43:0/2619874336 reap_dead start 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 shutdown_connections 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 >> 10.20.193.43:0/2619874336 conn(0x7f774808f480 msgr2=0x7f77481a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 shutdown_connections 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 1 -- 10.20.193.43:0/2619874336 wait complete. 2026-02-21T01:31:35.223 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.212+0000 7f774cb5c640 1 librados: shutdown 2026-02-21T01:31:35.223 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:31:35.223 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-21T01:31:35.224 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-21T01:31:35.224 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-21T01:31:35.224 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-21T01:31:35.224 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-21T01:31:35.224 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:31:35.233 INFO:tasks.ceph.mon.c:Stopped 2026-02-21T01:31:35.233 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-21T01:31:35.233 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:31:35.340 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.339+0000 7f050dc2b640 10 monclient: get_monmap_and_config 2026-02-21T01:31:35.340 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.339+0000 7f050dc2b640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.340 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.339+0000 7f050dc2b640 10 monclient: monmap: 2026-02-21T01:31:35.340 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.340 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:35.340670+0000 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:35.340670+0000 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:35.341 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.339+0000 7f050dc2b640 1 Processor -- start 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.339+0000 7f050dc2b640 1 -- start start 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.339+0000 7f050dc2b640 10 monclient: init 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient(hunting): picked mon.noname-b con 0x7f050805cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient(hunting): picked mon.noname-a con 0x7f050808a730 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient(hunting): picked mon.noname-c con 0x7f050813fa20 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050805d9d0 con 0x7f050808a730 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050808b590 con 0x7f050813fa20 2026-02-21T01:31:35.345 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050805b9c0 con 0x7f050805cef0 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05077fe640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f050805cef0 legacy=0x7f050805d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient(hunting): authenticate will time out at 827.046117s 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f0506ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f050808a730 0x7f0508180300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40776/0 (socket says 10.20.193.43:40776) 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f0506ffd640 1 -- 10.20.193.43:0/1909297783 learned_addr learned my addr 10.20.193.43:0/1909297783 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421441187 0 0) 0x7f050805d9d0 con 0x7f050808a730 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient(hunting): my global_id is 24918 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04ec003610 con 0x7f050808a730 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 666562114 0 0) 0x7f04ec003610 con 0x7f050808a730 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 >> v1:10.20.193.43:6790/0 conn(0x7f050805cef0 legacy=0x7f050805d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 >> v1:10.20.193.46:6789/0 conn(0x7f050813fa20 legacy=0x7f05081a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 monclient: found mon.noname-a 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050813f210 con 0x7f050808a730 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f04f8002df0 con 0x7f050808a730 2026-02-21T01:31:35.346 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: dump: 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 5 monclient: authenticate success, global_id 24918 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04f80030f0 con 0x7f050808a730 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 1 -- 10.20.193.43:0/1909297783 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f04f8003530 con 0x7f050808a730 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f05067fc640 10 monclient: dump: 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.347 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 4 set_mon_vals no callback set 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 10 monclient: shutdown 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- 10.20.193.43:0/1909297783 >> v1:10.20.193.43:6789/0 conn(0x7f050808a730 legacy=0x7f0508180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- 10.20.193.43:0/1909297783 shutdown_connections 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- 10.20.193.43:0/1909297783 >> 10.20.193.43:0/1909297783 conn(0x7f050808f480 msgr2=0x7f050808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- 10.20.193.43:0/1909297783 shutdown_connections 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.340+0000 7f050dc2b640 1 -- 10.20.193.43:0/1909297783 wait complete. 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient: build_initial_monmap 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient: monmap: 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 librados: starting msgr at 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 librados: starting objecter 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 Processor -- start 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 -- start start 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 librados: setting wanted keys 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 librados: calling monclient init 2026-02-21T01:31:35.348 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient: init 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient(hunting): picked mon.noname-a con 0x7f050805cef0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient(hunting): picked mon.noname-b con 0x7f050808a730 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient(hunting): picked mon.noname-c con 0x7f050813fa20 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050813bb00 con 0x7f050805cef0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050805e1b0 con 0x7f050808a730 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050812a1e0 con 0x7f050813fa20 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f050dc2b640 10 monclient(hunting): authenticate will time out at 827.047896s 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f0507fff640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f050813fa20 legacy=0x7f0508191af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f05077fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f050805cef0 0x7f050814f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40792/0 (socket says 10.20.193.43:40792) 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f05077fe640 1 -- 10.20.193.43:0/2101886111 learned_addr learned my addr 10.20.193.43:0/2101886111 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f04e3fff640 10 client.?.objecter ms_handle_connect 0x7f050805cef0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.341+0000 7f04e3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255820204 0 0) 0x7f050813bb00 con 0x7f050805cef0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): _negotiate 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): my global_id is 24921 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04d8003610 con 0x7f050805cef0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 521401294 0 0) 0x7f04d8003610 con 0x7f050805cef0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f050813bb00 con 0x7f050805cef0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f04f4004230 con 0x7f050805cef0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): dump: 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.349 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2471371485 0 0) 0x7f050813bb00 con 0x7f050805cef0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 >> v1:10.20.193.43:6790/0 conn(0x7f050813fa20 legacy=0x7f0508191af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 >> v1:10.20.193.46:6789/0 conn(0x7f050808a730 legacy=0x7f05081903d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: _finish_hunting 0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 monclient: found mon.a 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050812c540 con 0x7f050805cef0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: _finish_auth 0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: _check_auth_tickets 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 client.?.objecter ms_handle_connect 0x7f050808a730 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 5 monclient: authenticate success, global_id 24921 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 monclient: _renew_subs 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f050812bca0 con 0x7f050805cef0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 client.24921.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 monclient: _renew_subs 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05081297b0 con 0x7f050805cef0 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 1 librados: init done 2026-02-21T01:31:35.350 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04f40044c0 con 0x7f050805cef0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f04f40048d0 con 0x7f050805cef0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 10 monclient: dump: 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f0505ffb640 4 set_mon_vals no callback set 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0508129b40 con 0x7f050805cef0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.342+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f04f4004a70 con 0x7f050805cef0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.343+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 4649+0+0 (unknown 682319743 0 0) 0x7f04f404e1f0 con 0x7f050805cef0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.343+0000 7f04e3fff640 10 client.24921.objecter ms_dispatch2 0x7f0508000b90 osd_map(199..199 src has 1..199) 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.343+0000 7f04e3fff640 3 client.24921.objecter handle_osd_map got epochs [199,199] > 0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.343+0000 7f04e3fff640 3 client.24921.objecter handle_osd_map decoding full epoch 199 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.343+0000 7f04e3fff640 20 client.24921.objecter dump_active .. 0 homeless 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.343+0000 7f0506ffd640 10 monclient: get_auth_request con 0x7f04d803e8c0 auth_method 0 2026-02-21T01:31:35.351 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.343+0000 7f04e3fff640 10 client.24921.objecter ms_handle_connect 0x7f04d803e8c0 2026-02-21T01:31:35.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.345+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f04f4017700 con 0x7f050805cef0 2026-02-21T01:31:35.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.345+0000 7f04e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:35.352 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.345+0000 7f04e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:35.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.497+0000 7f050dc2b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:31:35.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.497+0000 7f050dc2b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:35.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.497+0000 7f050dc2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:35.499 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.497+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0508054ff0 con 0x7f050805cef0 2026-02-21T01:31:35.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.497+0000 7f04e3fff640 1 -- 10.20.193.43:0/2101886111 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 2762332927) 0x7f04f401c6e0 con 0x7f050805cef0 2026-02-21T01:31:35.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.497+0000 7f04e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:35.500 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.497+0000 7f04e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:35.500 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 10 librados: watch_flush enter 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 10 librados: watch_flush exit 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 20 client.24921.objecter shutdown clearing up homeless session... 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 10 client.24921.objecter successfully canceled tick 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 >> v1:10.20.193.46:6812/860801619 conn(0x7f04d803e8c0 legacy=0x7f04d805ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 10 monclient: shutdown 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:35.502 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 >> v1:10.20.193.43:6789/0 conn(0x7f050805cef0 legacy=0x7f050814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:35.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 shutdown_connections 2026-02-21T01:31:35.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 >> 10.20.193.43:0/2101886111 conn(0x7f050808f480 msgr2=0x7f050813dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:35.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 shutdown_connections 2026-02-21T01:31:35.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 1 -- 10.20.193.43:0/2101886111 wait complete. 2026-02-21T01:31:35.503 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:35.498+0000 7f050dc2b640 1 librados: shutdown 2026-02-21T01:31:38.509 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:31:38.578 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.577+0000 7fa467b8a640 10 monclient: get_monmap_and_config 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.577+0000 7fa467b8a640 10 monclient: build_initial_monmap 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.577+0000 7fa467b8a640 10 monclient: monmap: 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:38.579045+0000 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:38.579045+0000 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:38.579 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 1 Processor -- start 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 1 -- start start 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient: init 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient(hunting): picked mon.noname-c con 0x7fa4600890e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient(hunting): picked mon.noname-a con 0x7fa46008a170 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient(hunting): picked mon.noname-b con 0x7fa46008a540 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa460087750 con 0x7fa46008a170 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa460087a30 con 0x7fa4600890e0 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa460086560 con 0x7fa46008a540 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 10 monclient(hunting): authenticate will time out at 830.284513s 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa466100640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fa46008a540 legacy=0x7fa46019ef90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:38.580 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4650fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fa46008a170 0x7fa46017d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40800/0 (socket says 10.20.193.43:40800) 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4650fe640 1 -- 10.20.193.43:0/3431939026 learned_addr learned my addr 10.20.193.43:0/3431939026 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022476154 0 0) 0x7fa460087750 con 0x7fa46008a170 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient(hunting): my global_id is 24924 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa448003610 con 0x7fa46008a170 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2019379585 0 0) 0x7fa448003610 con 0x7fa46008a170 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 >> v1:10.20.193.43:6790/0 conn(0x7fa46008a540 legacy=0x7fa46019ef90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 >> v1:10.20.193.46:6789/0 conn(0x7fa4600890e0 legacy=0x7fa460089a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient: _finish_hunting 0 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 monclient: found mon.noname-a 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46008af90 con 0x7fa46008a170 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient: _finish_auth 0 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient: _check_auth_tickets 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa454002df0 con 0x7fa46008a170 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 5 monclient: authenticate success, global_id 24924 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa4648fd640 10 monclient: dump: 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.578+0000 7fa467b8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa454003080 con 0x7fa46008a170 2026-02-21T01:31:38.581 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa4648fd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa4648fd640 1 -- 10.20.193.43:0/3431939026 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa4540034c0 con 0x7fa46008a170 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa4648fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa4648fd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa4648fd640 10 monclient: dump: 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 4 set_mon_vals no callback set 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 10 monclient: shutdown 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 -- 10.20.193.43:0/3431939026 >> v1:10.20.193.43:6789/0 conn(0x7fa46008a170 legacy=0x7fa46017d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 -- 10.20.193.43:0/3431939026 shutdown_connections 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 -- 10.20.193.43:0/3431939026 >> 10.20.193.43:0/3431939026 conn(0x7fa46008f480 msgr2=0x7fa46008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 -- 10.20.193.43:0/3431939026 shutdown_connections 2026-02-21T01:31:38.582 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 -- 10.20.193.43:0/3431939026 wait complete. 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 10 monclient: build_initial_monmap 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 10 monclient: monmap: 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 librados: starting msgr at 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 librados: starting objecter 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 Processor -- start 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 -- start start 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 librados: setting wanted keys 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 1 librados: calling monclient init 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.579+0000 7fa467b8a640 10 monclient: init 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient(hunting): picked mon.noname-c con 0x7fa4600890e0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient(hunting): picked mon.noname-b con 0x7fa46008a170 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient(hunting): picked mon.noname-a con 0x7fa46008a540 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa460191ad0 con 0x7fa46008a540 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4601920a0 con 0x7fa46008a170 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa4658ff640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fa4600890e0 legacy=0x7fa46018eb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46018f940 con 0x7fa4600890e0 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient(hunting): authenticate will time out at 830.286238s 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa466100640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fa46008a540 0x7fa4602364f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:40814/0 (socket says 10.20.193.43:40814) 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa466100640 1 -- 10.20.193.43:0/869201238 learned_addr learned my addr 10.20.193.43:0/869201238 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 client.?.objecter ms_handle_connect 0x7fa46008a540 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2974197305 0 0) 0x7fa460191ad0 con 0x7fa46008a540 2026-02-21T01:31:38.584 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): my global_id is 24927 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa430003610 con 0x7fa46008a540 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4220151294 0 0) 0x7fa430003610 con 0x7fa46008a540 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa460191ad0 con 0x7fa46008a540 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa45c004480 con 0x7fa46008a540 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): dump: 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 client.?.objecter ms_handle_connect 0x7fa46008a170 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2085759659 0 0) 0x7fa460191ad0 con 0x7fa46008a540 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 >> v1:10.20.193.43:6790/0 conn(0x7fa4600890e0 legacy=0x7fa46018eb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 >> v1:10.20.193.46:6789/0 conn(0x7fa46008a170 legacy=0x7fa46018f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 monclient: found mon.a 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4601905e0 con 0x7fa46008a540 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: _finish_auth 0 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 5 monclient: authenticate success, global_id 24927 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient: _renew_subs 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:38.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa460192940 con 0x7fa46008a540 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 client.24927.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient: _renew_subs 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4601a52b0 con 0x7fa46008a540 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa467b8a640 1 librados: init done 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa45c004690 con 0x7fa46008a540 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa45c004aa0 con 0x7fa46008a540 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44e7fc640 10 monclient: dump: 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.580+0000 7fa44ffff640 4 set_mon_vals no callback set 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa467b8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa467b8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa467b8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4600008d0 con 0x7fa46008a540 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fa45c004c40 con 0x7fa46008a540 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 4649+0+0 (unknown 682319743 0 0) 0x7fa45c04e410 con 0x7fa46008a540 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa44e7fc640 10 client.24927.objecter ms_dispatch2 0x7fa460000b90 osd_map(199..199 src has 1..199) 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa44e7fc640 3 client.24927.objecter handle_osd_map got epochs [199,199] > 0 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa44e7fc640 3 client.24927.objecter handle_osd_map decoding full epoch 199 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa44e7fc640 20 client.24927.objecter dump_active .. 0 homeless 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.581+0000 7fa4658ff640 10 monclient: get_auth_request con 0x7fa43003e8a0 auth_method 0 2026-02-21T01:31:38.586 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.582+0000 7fa44e7fc640 10 client.24927.objecter ms_handle_connect 0x7fa43003e8a0 2026-02-21T01:31:38.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.583+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa45c017980 con 0x7fa46008a540 2026-02-21T01:31:38.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.583+0000 7fa44e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:38.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.583+0000 7fa44e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:38.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.734+0000 7fa467b8a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:31:38.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.734+0000 7fa467b8a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:38.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.734+0000 7fa467b8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:38.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.734+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa460237c10 con 0x7fa46008a540 2026-02-21T01:31:38.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.734+0000 7fa44e7fc640 1 -- 10.20.193.43:0/869201238 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 4109334451) 0x7fa45c017280 con 0x7fa46008a540 2026-02-21T01:31:38.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.734+0000 7fa44e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:38.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.734+0000 7fa44e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:38.736 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:31:38.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 10 librados: watch_flush enter 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 10 librados: watch_flush exit 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 20 client.24927.objecter shutdown clearing up homeless session... 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 10 client.24927.objecter successfully canceled tick 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 >> v1:10.20.193.46:6812/860801619 conn(0x7fa43003e8a0 legacy=0x7fa43005ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 10 monclient: shutdown 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 >> v1:10.20.193.43:6789/0 conn(0x7fa46008a540 legacy=0x7fa4602364f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 shutdown_connections 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 >> 10.20.193.43:0/869201238 conn(0x7fa46008f480 msgr2=0x7fa460057fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 shutdown_connections 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 1 -- 10.20.193.43:0/869201238 wait complete. 2026-02-21T01:31:38.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:38.735+0000 7fa467b8a640 1 librados: shutdown 2026-02-21T01:31:41.745 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:31:41.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient: get_monmap_and_config 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient: build_initial_monmap 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient: monmap: 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:41.815430+0000 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:41.815430+0000 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:41.817 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 1 Processor -- start 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 1 -- start start 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient: init 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient(hunting): picked mon.noname-a con 0x7fec50038ed0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient(hunting): picked mon.noname-b con 0x7fec5008bdf0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:41.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient(hunting): picked mon.noname-c con 0x7fec501819e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500392a0 con 0x7fec50038ed0 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec47fff640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec501802c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5005e070 con 0x7fec501819e0 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5008f210 con 0x7fec5008bdf0 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec56ece640 10 monclient(hunting): authenticate will time out at 833.520844s 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec54c43640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fec50038ed0 0x7fec5008b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36974/0 (socket says 10.20.193.43:36974) 2026-02-21T01:31:41.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:41.815+0000 7fec54c43640 1 -- 10.20.193.43:0/3237763253 learned_addr learned my addr 10.20.193.43:0/3237763253 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:42.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:42.016+0000 7fec47fff640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec501802c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:42.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:42.417+0000 7fec47fff640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec501802c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:43.218 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:43.218+0000 7fec47fff640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec501802c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:44.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient(hunting): tick 2026-02-21T01:31:44.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:31:44.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 1 monclient(hunting): continuing hunt 2026-02-21T01:31:44.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:31:44.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec501802c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.46:6789/0 conn(0x7fec501819e0 legacy=0x7fec501a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6789/0 conn(0x7fec50038ed0 legacy=0x7fec5008b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient(hunting): picked mon.noname-a con 0x7fec340037b0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient(hunting): picked mon.noname-b con 0x7fec5008bdf0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient(hunting): picked mon.noname-c con 0x7fec501819e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5008d100 con 0x7fec340037b0 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5008f210 con 0x7fec501819e0 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3406a4d0 con 0x7fec5008bdf0 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec467fc640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:44.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:44.815+0000 7fec47fff640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:45.016 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:45.016+0000 7fec47fff640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:45.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:45.417+0000 7fec47fff640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:46.219 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:46.218+0000 7fec47fff640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:47.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient(hunting): tick 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 1 monclient(hunting): continuing hunt 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.46:6789/0 conn(0x7fec501819e0 legacy=0x7fec34066cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6789/0 conn(0x7fec340037b0 legacy=0x7fec34023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient(hunting): picked mon.noname-a con 0x7fec3406a720 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient(hunting): picked mon.noname-c con 0x7fec501819e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient(hunting): picked mon.noname-b con 0x7fec5008bdf0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3406b770 con 0x7fec3406a720 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3406a4d0 con 0x7fec501819e0 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3406b470 con 0x7fec5008bdf0 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec467fc640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:47.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:47.816+0000 7fec55444640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:48.017 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:48.017+0000 7fec55444640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:48.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:48.418+0000 7fec55444640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:49.219 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.219+0000 7fec55444640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:49.432 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.431+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216353842 0 0) 0x7fec3406b770 con 0x7fec3406a720 2026-02-21T01:31:49.433 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.431+0000 7fec477fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.433 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.431+0000 7fec477fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.433 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.431+0000 7fec477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.433 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.431+0000 7fec477fe640 10 monclient(hunting): my global_id is 24930 2026-02-21T01:31:49.433 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.431+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c003610 con 0x7fec3406a720 2026-02-21T01:31:49.434 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.432+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003235819 0 0) 0x7fec3406a4d0 con 0x7fec501819e0 2026-02-21T01:31:49.434 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.432+0000 7fec477fe640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.434 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.432+0000 7fec477fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.434 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.432+0000 7fec477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.434 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.432+0000 7fec477fe640 10 monclient(hunting): my global_id is 84151 2026-02-21T01:31:49.434 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.432+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3406b770 con 0x7fec501819e0 2026-02-21T01:31:49.439 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1017353066 0 0) 0x7fec3c003610 con 0x7fec3406a720 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec34045480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.46:6789/0 conn(0x7fec501819e0 legacy=0x7fec340673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 10 monclient: _finish_hunting 0 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 1 monclient: found mon.noname-a 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec34066d60 con 0x7fec3406a720 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 10 monclient: _finish_auth 0 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 10 monclient: _check_auth_tickets 2026-02-21T01:31:49.440 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fec40002d50 con 0x7fec3406a720 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec477fe640 10 monclient: dump: 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.441 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.442 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec56ece640 5 monclient: authenticate success, global_id 24930 2026-02-21T01:31:49.442 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.438+0000 7fec56ece640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:49.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec40002f60 con 0x7fec3406a720 2026-02-21T01:31:49.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec477fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:49.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:49.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 4 set_mon_vals no callback set 2026-02-21T01:31:49.449 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec477fe640 1 -- 10.20.193.43:0/3237763253 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fec40003370 con 0x7fec3406a720 2026-02-21T01:31:49.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.450 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec477fe640 10 monclient: dump: 2026-02-21T01:31:49.450 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.450 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.450 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.451 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.451 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.451 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.451 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.451 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.451 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.452 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 10 monclient: shutdown 2026-02-21T01:31:49.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:49.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 1 -- 10.20.193.43:0/3237763253 >> v1:10.20.193.43:6789/0 conn(0x7fec3406a720 legacy=0x7fec3406ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 1 -- 10.20.193.43:0/3237763253 shutdown_connections 2026-02-21T01:31:49.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 1 -- 10.20.193.43:0/3237763253 >> 10.20.193.43:0/3237763253 conn(0x7fec5008c8e0 msgr2=0x7fec5008d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:49.452 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 1 -- 10.20.193.43:0/3237763253 shutdown_connections 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.440+0000 7fec56ece640 1 -- 10.20.193.43:0/3237763253 wait complete. 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.441+0000 7fec56ece640 10 monclient: build_initial_monmap 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.441+0000 7fec56ece640 10 monclient: monmap: 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:49.453 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.454 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:49.454 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:49.454 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:49.454 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.454 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.441+0000 7fec56ece640 1 librados: starting msgr at 2026-02-21T01:31:49.454 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.441+0000 7fec56ece640 1 librados: starting objecter 2026-02-21T01:31:49.454 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.441+0000 7fec56ece640 1 Processor -- start 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 -- start start 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 librados: setting wanted keys 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 librados: calling monclient init 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient: init 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient(hunting): picked mon.noname-b con 0x7fec3406a720 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient(hunting): picked mon.noname-c con 0x7fec5008bdf0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:49.455 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient(hunting): picked mon.noname-a con 0x7fec501819e0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:49.456 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5013a510 con 0x7fec501819e0 2026-02-21T01:31:49.456 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500869a0 con 0x7fec3406a720 2026-02-21T01:31:49.456 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec50138940 con 0x7fec5008bdf0 2026-02-21T01:31:49.456 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:49.456 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient(hunting): authenticate will time out at 841.147358s 2026-02-21T01:31:49.456 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec47fff640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec50170560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:49.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec55444640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fec501819e0 0x7fec50171c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:36998/0 (socket says 10.20.193.43:36998) 2026-02-21T01:31:49.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec55444640 1 -- 10.20.193.43:0/1071261252 learned_addr learned my addr 10.20.193.43:0/1071261252 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:49.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 client.?.objecter ms_handle_connect 0x7fec501819e0 2026-02-21T01:31:49.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:49.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431139487 0 0) 0x7fec5013a510 con 0x7fec501819e0 2026-02-21T01:31:49.457 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.458 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.458 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.458 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): my global_id is 24933 2026-02-21T01:31:49.458 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec20003610 con 0x7fec501819e0 2026-02-21T01:31:49.458 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 205906451 0 0) 0x7fec20003610 con 0x7fec501819e0 2026-02-21T01:31:49.458 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec5013a510 con 0x7fec501819e0 2026-02-21T01:31:49.459 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fec4c003410 con 0x7fec501819e0 2026-02-21T01:31:49.459 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:49.459 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:49.459 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): dump: 2026-02-21T01:31:49.459 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.459 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.460 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.460 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.460 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.460 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.460 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.460 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.461 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.461 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.461 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:49.461 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 client.?.objecter ms_handle_connect 0x7fec3406a720 2026-02-21T01:31:49.461 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:49.461 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1297774183 0 0) 0x7fec5013a510 con 0x7fec501819e0 2026-02-21T01:31:49.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 >> v1:10.20.193.43:6790/0 conn(0x7fec5008bdf0 legacy=0x7fec50170560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:31:49.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 >> v1:10.20.193.46:6789/0 conn(0x7fec3406a720 legacy=0x7fec500829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: _finish_hunting 0 2026-02-21T01:31:49.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 monclient: found mon.a 2026-02-21T01:31:49.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:49.462 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.463 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50139660 con 0x7fec501819e0 2026-02-21T01:31:49.463 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: _finish_auth 0 2026-02-21T01:31:49.463 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: _check_auth_tickets 2026-02-21T01:31:49.463 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:49.463 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 5 monclient: authenticate success, global_id 24933 2026-02-21T01:31:49.463 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient: _renew_subs 2026-02-21T01:31:49.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fec500830f0 con 0x7fec501819e0 2026-02-21T01:31:49.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec4c0037e0 con 0x7fec501819e0 2026-02-21T01:31:49.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:49.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 client.24933.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:49.464 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fec4c003d70 con 0x7fec501819e0 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient: _renew_subs 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fec50138320 con 0x7fec501819e0 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec46ffd640 4 set_mon_vals no callback set 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec56ece640 1 librados: init done 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.442+0000 7fec457fa640 10 monclient: dump: 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.465 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fec4c003f10 con 0x7fec501819e0 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec56ece640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:49.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec56ece640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:49.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec56ece640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec50139230 con 0x7fec501819e0 2026-02-21T01:31:49.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(200..200 src has 1..200) ==== 5022+0+0 (unknown 1751046227 0 0) 0x7fec4c04e670 con 0x7fec501819e0 2026-02-21T01:31:49.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec457fa640 10 client.24933.objecter ms_dispatch2 0x7fec50000b90 osd_map(200..200 src has 1..200) 2026-02-21T01:31:49.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec457fa640 3 client.24933.objecter handle_osd_map got epochs [200,200] > 0 2026-02-21T01:31:49.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec457fa640 3 client.24933.objecter handle_osd_map decoding full epoch 200 2026-02-21T01:31:49.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec457fa640 20 client.24933.objecter dump_active .. 0 homeless 2026-02-21T01:31:49.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.443+0000 7fec54c43640 10 monclient: get_auth_request con 0x7fec2003e8a0 auth_method 0 2026-02-21T01:31:49.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.446+0000 7fec457fa640 10 client.24933.objecter ms_handle_connect 0x7fec2003e8a0 2026-02-21T01:31:49.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.446+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fec4c017a70 con 0x7fec501819e0 2026-02-21T01:31:49.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.446+0000 7fec457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:49.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.446+0000 7fec457fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:49.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.596+0000 7fec56ece640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:31:49.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.596+0000 7fec56ece640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:49.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.596+0000 7fec56ece640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.596+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fec50054ff0 con 0x7fec501819e0 2026-02-21T01:31:49.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.596+0000 7fec457fa640 1 -- 10.20.193.43:0/1071261252 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1460 (unknown 254746657 0 1998843358) 0x7fec4c017370 con 0x7fec501819e0 2026-02-21T01:31:49.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.596+0000 7fec457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:31:49.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.596+0000 7fec457fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:49.598 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":24,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:31:49.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 10 librados: watch_flush enter 2026-02-21T01:31:49.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 10 librados: watch_flush exit 2026-02-21T01:31:49.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 20 client.24933.objecter shutdown clearing up homeless session... 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 10 client.24933.objecter successfully canceled tick 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 >> v1:10.20.193.46:6812/860801619 conn(0x7fec2003e8a0 legacy=0x7fec2005ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 10 monclient: shutdown 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.597+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 >> v1:10.20.193.43:6789/0 conn(0x7fec501819e0 legacy=0x7fec50171c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.598+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 shutdown_connections 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.598+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 >> 10.20.193.43:0/1071261252 conn(0x7fec5008c8e0 msgr2=0x7fec50083950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.598+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 shutdown_connections 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.598+0000 7fec56ece640 1 -- 10.20.193.43:0/1071261252 wait complete. 2026-02-21T01:31:49.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.598+0000 7fec56ece640 1 librados: shutdown 2026-02-21T01:31:49.607 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-21T01:31:49.608 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-21T01:31:49.608 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:31:49.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.676+0000 7f01b4afb640 10 monclient: get_monmap_and_config 2026-02-21T01:31:49.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.676+0000 7f01b4afb640 10 monclient: build_initial_monmap 2026-02-21T01:31:49.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.676+0000 7f01b4afb640 10 monclient: monmap: 2026-02-21T01:31:49.687 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:49.687 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:49.677003+0000 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:49.677003+0000 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:49.688 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 1 Processor -- start 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 1 -- start start 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient: init 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient(hunting): picked mon.noname-c con 0x7f01b008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient(hunting): picked mon.noname-a con 0x7f01b008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient(hunting): picked mon.noname-b con 0x7f01b008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b008a690 con 0x7f01b008d4d0 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b008b910 con 0x7f01b008ddb0 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b0088ae0 con 0x7f01b008d8d0 2026-02-21T01:31:49.689 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient(hunting): authenticate will time out at 841.382407s 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01aed76640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f01b008d8d0 legacy=0x7f01b019f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01add74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f01b008d4d0 0x7f01b017e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37014/0 (socket says 10.20.193.43:37014) 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01add74640 1 -- 10.20.193.43:0/1836815129 learned_addr learned my addr 10.20.193.43:0/1836815129 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271716500 0 0) 0x7f01b008a690 con 0x7f01b008d4d0 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient(hunting): my global_id is 24936 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f019c003610 con 0x7f01b008d4d0 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 505021256 0 0) 0x7f019c003610 con 0x7f01b008d4d0 2026-02-21T01:31:49.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 >> v1:10.20.193.43:6790/0 conn(0x7f01b008d8d0 legacy=0x7f01b019f7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 >> v1:10.20.193.46:6789/0 conn(0x7f01b008ddb0 legacy=0x7f01b008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: _finish_hunting 0 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 monclient: found mon.noname-a 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b01a3ef0 con 0x7f01b008d4d0 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: _finish_auth 0 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: _check_auth_tickets 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0198002df0 con 0x7f01b008d4d0 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: dump: 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 5 monclient: authenticate success, global_id 24936 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01980030f0 con 0x7f01b008d4d0 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 1 -- 10.20.193.43:0/1836815129 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f0198003530 con 0x7f01b008d4d0 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01ad573640 10 monclient: dump: 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.693 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.677+0000 7f01b4afb640 4 set_mon_vals no callback set 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient: shutdown 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- 10.20.193.43:0/1836815129 >> v1:10.20.193.43:6789/0 conn(0x7f01b008d4d0 legacy=0x7f01b017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- 10.20.193.43:0/1836815129 shutdown_connections 2026-02-21T01:31:49.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- 10.20.193.43:0/1836815129 >> 10.20.193.43:0/1836815129 conn(0x7f01b008f480 msgr2=0x7f01b008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- 10.20.193.43:0/1836815129 shutdown_connections 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- 10.20.193.43:0/1836815129 wait complete. 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient: build_initial_monmap 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient: monmap: 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:49.695 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 librados: starting msgr at 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 librados: starting objecter 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 Processor -- start 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- start start 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 librados: setting wanted keys 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 librados: calling monclient init 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient: init 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:31:49.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient(hunting): picked mon.noname-c con 0x7f01b008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient(hunting): picked mon.noname-b con 0x7f01b008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 10 monclient(hunting): picked mon.noname-a con 0x7f01b008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b0127bf0 con 0x7f01b008ddb0 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.678+0000 7f01b4afb640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b0127ed0 con 0x7f01b008d8d0 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b013a4c0 con 0x7f01b008d4d0 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 monclient(hunting): authenticate will time out at 841.384007s 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01ae575640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f01b008d4d0 legacy=0x7f01b01241a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01aed76640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f01b008ddb0 0x7f01b0124fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37026/0 (socket says 10.20.193.43:37026) 2026-02-21T01:31:49.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01aed76640 1 -- 10.20.193.43:0/396933527 learned_addr learned my addr 10.20.193.43:0/396933527 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 client.?.objecter ms_handle_connect 0x7f01b008ddb0 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538892722 0 0) 0x7f01b0127bf0 con 0x7f01b008ddb0 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): my global_id is 24939 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017c003610 con 0x7f01b008ddb0 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4135305548 0 0) 0x7f017c003610 con 0x7f01b008ddb0 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01b0127bf0 con 0x7f01b008ddb0 2026-02-21T01:31:49.698 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f01a0004480 con 0x7f01b008ddb0 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): dump: 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.699 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3448760370 0 0) 0x7f01b0127bf0 con 0x7f01b008ddb0 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.43:6790/0 conn(0x7f01b008d4d0 legacy=0x7f01b01241a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.46:6789/0 conn(0x7f01b008d8d0 legacy=0x7f01b01248b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 monclient: found mon.a 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b0125b70 con 0x7f01b008ddb0 2026-02-21T01:31:49.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: _finish_auth 0 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 client.?.objecter ms_handle_connect 0x7f01b008d8d0 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 5 monclient: authenticate success, global_id 24939 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 monclient: _renew_subs 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f01b0127630 con 0x7f01b008ddb0 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 client.24939.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01a0004710 con 0x7f01b008ddb0 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f01a0004b20 con 0x7f01b008ddb0 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient: dump: 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 monclient: _renew_subs 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01acd72640 4 set_mon_vals no callback set 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f01b0127300 con 0x7f01b008ddb0 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 1 librados: init done 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f01b008edd0 con 0x7f01b01a10d0 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 client.24939.objecter ms_handle_connect 0x7f01b01a10d0 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 client.24939.objecter resend_mon_ops 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855470820 0 0) 0x7f01b008edd0 con 0x7f01b01a10d0 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 10 monclient(hunting): my global_id is 24942 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01b0127bf0 con 0x7f01b01a10d0 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.679+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f01a0004cc0 con 0x7f01b008ddb0 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(200..200 src has 1..200) ==== 5022+0+0 (unknown 1751046227 0 0) 0x7f01a004e520 con 0x7f01b008ddb0 2026-02-21T01:31:49.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 10 client.24939.objecter ms_dispatch2 0x7f01b0000b90 osd_map(200..200 src has 1..200) 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 3 client.24939.objecter handle_osd_map got epochs [200,200] > 0 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 3 client.24939.objecter handle_osd_map decoding full epoch 200 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 20 client.24939.objecter dump_active .. 0 homeless 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3757344091 0 0) 0x7f01b0127bf0 con 0x7f01b01a10d0 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01b008edd0 con 0x7f01b01a10d0 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f01a4002e70 con 0x7f01b01a10d0 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 10 monclient: dump: 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.704 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3410649963 0 0) 0x7f01b008edd0 con 0x7f01b01a10d0 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01b00008d0 con 0x7f01b01a10d0 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f01add74640 10 monclient: get_auth_request con 0x7f017c03e9c0 auth_method 0 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f01a4002e30 con 0x7f01b01a10d0 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.43:6789/0 conn(0x7f01b01a10d0 legacy=0x7f01b0120df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.43:6789/0 conn(0x7f01b01a10d0 legacy=0x7f01b0120df0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.680+0000 7f0196ffd640 10 client.24939.objecter ms_handle_connect 0x7f017c03e9c0 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f01b4afb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:49.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f01b004ce30 con 0x7f01b004ca30 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 10 client.24939.objecter ms_handle_connect 0x7f01b004ca30 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 10 client.24939.objecter resend_mon_ops 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822899801 0 0) 0x7f01b004ce30 con 0x7f01b004ca30 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 10 monclient(hunting): my global_id is 24945 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.683+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01b008edd0 con 0x7f01b004ca30 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3122993726 0 0) 0x7f01b008edd0 con 0x7f01b004ca30 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01b004ce30 con 0x7f01b004ca30 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f01a4004a20 con 0x7f01b004ca30 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 10 monclient: dump: 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.706 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4232463308 0 0) 0x7f01b004ce30 con 0x7f01b004ca30 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f01b012fb70 con 0x7f01b004ca30 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4307 (unknown 0 0 679646957) 0x7f01a4004c40 con 0x7f01b004ca30 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.43:6789/0 conn(0x7f01b004ca30 legacy=0x7f01b012d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.707 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f0196ffd640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.43:6789/0 conn(0x7f01b004ca30 legacy=0x7f01b012d440 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 24, 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 245314, 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:49.708 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: 1 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:49.709 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:49.710 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.711 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:49.712 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:49.713 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.714 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.715 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:49.716 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:49.717 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:49.718 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:49.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 10 librados: watch_flush enter 2026-02-21T01:31:49.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 10 librados: watch_flush exit 2026-02-21T01:31:49.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 20 client.24939.objecter shutdown clearing up homeless session... 2026-02-21T01:31:49.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 10 client.24939.objecter successfully canceled tick 2026-02-21T01:31:49.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.46:6812/860801619 conn(0x7f017c03e9c0 legacy=0x7f017c05ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 10 monclient: shutdown 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 >> v1:10.20.193.43:6789/0 conn(0x7f01b008ddb0 legacy=0x7f01b0124fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01aed76640 1 -- 10.20.193.43:0/396933527 reap_dead start 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01aed76640 1 -- 10.20.193.43:0/396933527 reap_dead start 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 shutdown_connections 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 >> 10.20.193.43:0/396933527 conn(0x7f01b008f480 msgr2=0x7f01b01a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 shutdown_connections 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 1 -- 10.20.193.43:0/396933527 wait complete. 2026-02-21T01:31:49.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.684+0000 7f01b4afb640 1 librados: shutdown 2026-02-21T01:31:49.721 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:31:49.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-21T01:31:49.722 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient: get_monmap_and_config 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient: build_initial_monmap 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient: monmap: 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:31:49.789441+0000 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:31:49.789441+0000 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:31:49.789 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 1 Processor -- start 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 1 -- start start 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient: init 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient(hunting): picked mon.noname-a con 0x7f1c6c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient(hunting): picked mon.noname-b con 0x7f1c6c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:49.793 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient(hunting): picked mon.noname-c con 0x7f1c6c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c08a690 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c08b910 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c088ae0 con 0x7f1c6c08d4d0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c70a0b640 10 monclient(hunting): authenticate will time out at 841.494834s 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c69d74640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f1c6c08d4d0 legacy=0x7f1c6c17e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c6a575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f1c6c08ddb0 0x7f1c6c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37054/0 (socket says 10.20.193.43:37054) 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.789+0000 7f1c6a575640 1 -- 10.20.193.43:0/2767222511 learned_addr learned my addr 10.20.193.43:0/2767222511 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590690303 0 0) 0x7f1c6c08a690 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient(hunting): my global_id is 24948 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c58003610 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 540185577 0 0) 0x7f1c58003610 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 >> v1:10.20.193.43:6790/0 conn(0x7f1c6c08d4d0 legacy=0x7f1c6c17e070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 >> v1:10.20.193.46:6789/0 conn(0x7f1c6c08d8d0 legacy=0x7f1c6c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: _finish_hunting 0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 monclient: found mon.noname-a 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c1a3ef0 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: _finish_auth 0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: _check_auth_tickets 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1c60002df0 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.794 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 5 monclient: authenticate success, global_id 24948 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: dump: 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c600030f0 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 1 -- 10.20.193.43:0/2767222511 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1c60003530 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 10 monclient: get_monmap_and_config success 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 4 set_mon_vals no callback set 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c69573640 10 monclient: dump: 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.795 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 10 monclient: shutdown 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 1 -- 10.20.193.43:0/2767222511 >> v1:10.20.193.43:6789/0 conn(0x7f1c6c08ddb0 legacy=0x7f1c6c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 1 -- 10.20.193.43:0/2767222511 shutdown_connections 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 1 -- 10.20.193.43:0/2767222511 >> 10.20.193.43:0/2767222511 conn(0x7f1c6c08f480 msgr2=0x7f1c6c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 1 -- 10.20.193.43:0/2767222511 shutdown_connections 2026-02-21T01:31:49.796 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 1 -- 10.20.193.43:0/2767222511 wait complete. 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 10 monclient: build_initial_monmap 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.790+0000 7f1c70a0b640 10 monclient: monmap: 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 librados: starting msgr at 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 librados: starting objecter 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 Processor -- start 2026-02-21T01:31:49.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 -- start start 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 librados: setting wanted keys 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 librados: calling monclient init 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient: init 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient: _reopen_session rank -1 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient(hunting): picked mon.noname-c con 0x7f1c6c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient(hunting): picked mon.noname-a con 0x7f1c6c08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient(hunting): picked mon.noname-b con 0x7f1c6c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c087a40 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c6a575640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f1c6c08d4d0 legacy=0x7f1c6c11de80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c05e1b0 con 0x7f1c6c08ddb0 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c088030 con 0x7f1c6c08d4d0 2026-02-21T01:31:49.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient(hunting): _renew_subs 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient(hunting): authenticate will time out at 841.496458s 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c69d74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f1c6c08d8d0 0x7f1c6c14c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37066/0 (socket says 10.20.193.43:37066) 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c69d74640 1 -- 10.20.193.43:0/3742393808 learned_addr learned my addr 10.20.193.43:0/3742393808 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 client.?.objecter ms_handle_connect 0x7f1c6c08d8d0 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973371369 0 0) 0x7f1c6c087a40 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): my global_id is 24951 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c38003610 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3028482882 0 0) 0x7f1c38003610 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c6c087a40 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1c54004230 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): dump: 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2676024574 0 0) 0x7f1c6c087a40 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.43:6790/0 conn(0x7f1c6c08d4d0 legacy=0x7f1c6c11de80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.46:6789/0 conn(0x7f1c6c08ddb0 legacy=0x7f1c6c18e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 monclient: found mon.a 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c10b840 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: _finish_auth 0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 5 monclient: authenticate success, global_id 24951 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient: _renew_subs 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c10afa0 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 client.24951.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient: _renew_subs 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c540044c0 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c6c14ccc0 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c70a0b640 1 librados: init done 2026-02-21T01:31:49.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1c540048d0 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c68d72640 4 set_mon_vals no callback set 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.791+0000 7f1c52ffd640 10 monclient: dump: 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.802 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c70a0b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c6c08edd0 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f1c54004b30 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 client.24951.objecter ms_handle_connect 0x7f1c6c1a10d0 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 client.24951.objecter resend_mon_ops 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(200..200 src has 1..200) ==== 5022+0+0 (unknown 1751046227 0 0) 0x7f1c5404e420 con 0x7f1c6c08d8d0 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 client.24951.objecter ms_dispatch2 0x7f1c6c000b90 osd_map(200..200 src has 1..200) 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 3 client.24951.objecter handle_osd_map got epochs [200,200] > 0 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 3 client.24951.objecter handle_osd_map decoding full epoch 200 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 20 client.24951.objecter dump_active .. 0 homeless 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432245738 0 0) 0x7f1c6c08edd0 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 monclient(hunting): my global_id is 84163 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c6c087a40 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c6ad76640 10 monclient: get_auth_request con 0x7f1c3803e7c0 auth_method 0 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2657152969 0 0) 0x7f1c6c087a40 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c6c08edd0 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1c60003390 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.792+0000 7f1c52ffd640 10 monclient: dump: 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.804 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3757884061 0 0) 0x7f1c6c08edd0 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c6c0008d0 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 10 client.24951.objecter ms_handle_connect 0x7f1c3803e7c0 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1c60003390 con 0x7f1c6c1a10d0 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.46:6789/0 conn(0x7f1c6c1a10d0 legacy=0x7f1c6c058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.793+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.46:6789/0 conn(0x7f1c6c1a10d0 legacy=0x7f1c6c058410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.796+0000 7f1c70a0b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.796+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c6c058f20 con 0x7f1c6c058b20 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.796+0000 7f1c52ffd640 10 client.24951.objecter ms_handle_connect 0x7f1c6c058b20 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.796+0000 7f1c52ffd640 10 client.24951.objecter resend_mon_ops 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279967447 0 0) 0x7f1c6c058f20 con 0x7f1c6c058b20 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient(hunting): my global_id is 84166 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c6c08edd0 con 0x7f1c6c058b20 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 377982640 0 0) 0x7f1c6c08edd0 con 0x7f1c6c058b20 2026-02-21T01:31:49.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c6c058f20 con 0x7f1c6c058b20 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1c60004cc0 con 0x7f1c6c058b20 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient: dump: 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1258605878 0 0) 0x7f1c6c058f20 con 0x7f1c6c058b20 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1c6c0590f0 con 0x7f1c6c058b20 2026-02-21T01:31:49.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4471 (unknown 0 0 4279797679) 0x7f1c60004b90 con 0x7f1c6c058b20 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.46:6789/0 conn(0x7f1c6c058b20 legacy=0x7f1c6c191050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c52ffd640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.46:6789/0 conn(0x7f1c6c058b20 legacy=0x7f1c6c191050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 24, 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 16814, 2026-02-21T01:31:49.809 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: 1 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:49.810 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:49.811 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:31:49.812 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:31:49.813 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:31:49.814 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:31:49.815 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:31:49.816 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:49.817 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "num": 4 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:31:49.818 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:31:49.819 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:31:49.819 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:31:49.819 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:31:49.819 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:31:49.819 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:31:49.819 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:31:49.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 10 librados: watch_flush enter 2026-02-21T01:31:49.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 10 librados: watch_flush exit 2026-02-21T01:31:49.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 20 client.24951.objecter shutdown clearing up homeless session... 2026-02-21T01:31:49.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 10 client.24951.objecter successfully canceled tick 2026-02-21T01:31:49.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.46:6812/860801619 conn(0x7f1c3803e7c0 legacy=0x7f1c3805ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 10 monclient: shutdown 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 >> v1:10.20.193.43:6789/0 conn(0x7f1c6c08d8d0 legacy=0x7f1c6c14c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c6ad76640 1 -- 10.20.193.43:0/3742393808 reap_dead start 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c6ad76640 1 -- 10.20.193.43:0/3742393808 reap_dead start 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 shutdown_connections 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 >> 10.20.193.43:0/3742393808 conn(0x7f1c6c08f480 msgr2=0x7f1c6c11f280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 shutdown_connections 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 1 -- 10.20.193.43:0/3742393808 wait complete. 2026-02-21T01:31:49.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:31:49.797+0000 7f1c70a0b640 1 librados: shutdown 2026-02-21T01:31:49.821 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:31:49.821 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-21T01:32:08.431 INFO:tasks.workunit.client.0.trial046.stdout:_aio: [ OK ] LibRadosAio.CancelBeforeComplete (2991 ms) 2026-02-21T01:32:08.431 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (17137 ms) 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [----------] 29 tests from LibRadosAio (100397 ms total) 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6867 ms) 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6999 ms) 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-21T01:32:08.432 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7007 ms) 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7004 ms) 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6992 ms) 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6995 ms) 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7010 ms) 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6997 ms) 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-21T01:32:08.433 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6994 ms) 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7009 ms) 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6997 ms) 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6996 ms) 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7010 ms) 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-21T01:32:08.434 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (20991 ms) 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7009 ms) 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7001 ms) 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (125887 ms total) 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [----------] Global test environment tear-down 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (226284 ms total) 2026-02-21T01:32:08.435 INFO:tasks.workunit.client.0.trial046.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout:o.RoundTripAppendPP (3006 ms) 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3002 ms) 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (2998 ms) 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3000 ms) 2026-02-21T01:32:54.425 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: sending pool EIO time: 2026-02-21T01:30:35.439033+0000 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (8999 ms) 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3002 ms) 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (138270 ms total) 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3007 ms) 2026-02-21T01:32:54.426 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (8997 ms) 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15000 ms) 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (2996 ms) 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30002 ms total) 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3007 ms) 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3007 ms total) 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-21T01:32:54.427 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13990 ms) 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7000 ms) 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (21002 ms) 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7011 ms) 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (2991 ms) 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7018 ms) 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6989 ms) 2026-02-21T01:32:54.428 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6995 ms) 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7018 ms) 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6993 ms) 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6991 ms) 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-21T01:32:54.429 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (6995 ms) 2026-02-21T01:33:19.822 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-21T01:33:19.822 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-21T01:33:19.823 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-21T01:33:19.835 INFO:tasks.ceph.mon.c:Started 2026-02-21T01:33:19.835 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:33:19.836 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:33:19.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 10 monclient: get_monmap_and_config 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 10 monclient: build_initial_monmap 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 10 monclient: monmap: 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:19.908677+0000 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:19.908677+0000 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:19.909 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:19.910 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:19.917 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 1 Processor -- start 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 1 -- start start 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 10 monclient: init 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.907+0000 7fefdddcf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 10 monclient(hunting): picked mon.noname-c con 0x7fefd808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 10 monclient(hunting): picked mon.noname-a con 0x7fefd808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 10 monclient(hunting): picked mon.noname-b con 0x7fefd808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd808a690 con 0x7fefd808d4d0 2026-02-21T01:33:19.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd808b910 con 0x7fefd808ddb0 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd8088ae0 con 0x7fefd808d8d0 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 10 monclient(hunting): authenticate will time out at 931.614057s 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd6ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fefd808d4d0 0x7fefd817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37820/0 (socket says 10.20.193.43:37820) 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd7fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fefd808d8d0 0x7fefd819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58738/0 (socket says 10.20.193.43:58738) 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd6ffd640 1 -- 10.20.193.43:0/2746568793 learned_addr learned my addr 10.20.193.43:0/2746568793 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461732720 0 0) 0x7fefd808a690 con 0x7fefd808d4d0 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient(hunting): _negotiate 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient(hunting): my global_id is 25020 2026-02-21T01:33:19.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefbc003610 con 0x7fefd808d4d0 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1331152571 0 0) 0x7fefbc003610 con 0x7fefd808d4d0 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 >> v1:10.20.193.43:6790/0 conn(0x7fefd808d8d0 legacy=0x7fefd819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 >> v1:10.20.193.46:6789/0 conn(0x7fefd808ddb0 legacy=0x7fefd808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: _finish_hunting 0 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 monclient: found mon.noname-a 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd81a3ef0 con 0x7fefd808d4d0 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: _finish_auth 0 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: _check_auth_tickets 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:19.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefc8002df0 con 0x7fefd808d4d0 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 5 monclient: authenticate success, global_id 25020 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: dump: 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:19.921 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefc80030f0 con 0x7fefd808d4d0 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 1 -- 10.20.193.43:0/2746568793 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefc80034f0 con 0x7fefd808d4d0 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 4 set_mon_vals no callback set 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:19.922 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefd67fc640 10 monclient: dump: 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 10 monclient: shutdown 2026-02-21T01:33:19.923 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- 10.20.193.43:0/2746568793 >> v1:10.20.193.43:6789/0 conn(0x7fefd808d4d0 legacy=0x7fefd817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- 10.20.193.43:0/2746568793 shutdown_connections 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- 10.20.193.43:0/2746568793 >> 10.20.193.43:0/2746568793 conn(0x7fefd808f480 msgr2=0x7fefd808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- 10.20.193.43:0/2746568793 shutdown_connections 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.908+0000 7fefdddcf640 1 -- 10.20.193.43:0/2746568793 wait complete. 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 10 monclient: build_initial_monmap 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 10 monclient: monmap: 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:19.924 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 1 librados: starting msgr at 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 1 librados: starting objecter 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 1 Processor -- start 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 1 -- start start 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 1 librados: setting wanted keys 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 1 librados: calling monclient init 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.909+0000 7fefdddcf640 10 monclient: init 2026-02-21T01:33:19.925 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 10 monclient(hunting): picked mon.noname-c con 0x7fefd808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 10 monclient(hunting): picked mon.noname-a con 0x7fefd808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 10 monclient(hunting): picked mon.noname-b con 0x7fefd808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd805e1b0 con 0x7fefd808d8d0 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd811e910 con 0x7fefd808ddb0 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd8105f70 con 0x7fefd808d4d0 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefdddcf640 10 monclient(hunting): authenticate will time out at 931.616074s 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefd77fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fefd808d4d0 0x7fefd811da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58754/0 (socket says 10.20.193.43:58754) 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefd77fe640 1 -- 10.20.193.43:0/1595939494 learned_addr learned my addr 10.20.193.43:0/1595939494 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:19.926 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefd6ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fefd808d8d0 0x7fefd818d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37826/0 (socket says 10.20.193.43:37826) 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 client.?.objecter ms_handle_connect 0x7fefd808d8d0 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 client.?.objecter ms_handle_connect 0x7fefd808d4d0 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 client.?.objecter ms_handle_connect 0x7fefd808ddb0 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755073444 0 0) 0x7fefd811e910 con 0x7fefd808ddb0 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 monclient(hunting): my global_id is 84265 2026-02-21T01:33:19.927 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa8003610 con 0x7fefd808ddb0 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1307905053 0 0) 0x7fefa8003610 con 0x7fefd808ddb0 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefd811e910 con 0x7fefd808ddb0 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefcc003490 con 0x7fefd808ddb0 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.910+0000 7fefb3fff640 10 monclient(hunting): dump: 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:19.928 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2565958975 0 0) 0x7fefd811e910 con 0x7fefd808ddb0 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 >> v1:10.20.193.43:6790/0 conn(0x7fefd808d4d0 legacy=0x7fefd811da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 >> v1:10.20.193.43:6789/0 conn(0x7fefd808d8d0 legacy=0x7fefd818d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 monclient: found mon.b 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:33:19.929 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd8105b70 con 0x7fefd808ddb0 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: _finish_auth 0 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 5 monclient: authenticate success, global_id 84265 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 monclient: _renew_subs 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 --> v1:10.20.193.46:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fefd811e110 con 0x7fefd808ddb0 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 client.84265.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 monclient: _renew_subs 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 --> v1:10.20.193.46:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fefd8107d80 con 0x7fefd808ddb0 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 1 librados: init done 2026-02-21T01:33:19.930 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefcc004c50 con 0x7fefd808ddb0 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fefcc005020 con 0x7fefd808ddb0 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefd5ffb640 4 set_mon_vals no callback set 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 monclient: dump: 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:19.931 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd808edd0 con 0x7fefd808ddb0 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fefcc0051c0 con 0x7fefd808ddb0 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 8 ==== osd_map(290..290 src has 1..290) ==== 4651+0+0 (unknown 2388582158 0 0) 0x7fefcc04e540 con 0x7fefd808ddb0 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 10 client.84265.objecter ms_dispatch2 0x7fefd8000b90 osd_map(290..290 src has 1..290) 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 3 client.84265.objecter handle_osd_map got epochs [290,290] > 0 2026-02-21T01:33:19.932 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 3 client.84265.objecter handle_osd_map decoding full epoch 290 2026-02-21T01:33:19.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.911+0000 7fefb3fff640 20 client.84265.objecter dump_active .. 0 homeless 2026-02-21T01:33:19.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.912+0000 7fefd77fe640 10 monclient: get_auth_request con 0x7fefa803e900 auth_method 0 2026-02-21T01:33:19.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.912+0000 7fefb3fff640 10 client.84265.objecter ms_handle_connect 0x7fefa803e900 2026-02-21T01:33:19.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.914+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fefcc017ab0 con 0x7fefd808ddb0 2026-02-21T01:33:19.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.914+0000 7fefb3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:19.933 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:19.914+0000 7fefb3fff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:20.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.062+0000 7fefdddcf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:33:20.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.062+0000 7fefdddcf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:20.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.062+0000 7fefdddcf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.46:6789/0 2026-02-21T01:33:20.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.062+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 --> v1:10.20.193.46:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fefd8109300 con 0x7fefd808ddb0 2026-02-21T01:33:20.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.062+0000 7fefb3fff640 1 -- 10.20.193.43:0/1595939494 <== mon.1 v1:10.20.193.46:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 1674807805) 0x7fefcc0173b0 con 0x7fefd808ddb0 2026-02-21T01:33:20.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.062+0000 7fefb3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:20.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.062+0000 7fefb3fff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:20.065 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:33:20.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 10 librados: watch_flush enter 2026-02-21T01:33:20.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 10 librados: watch_flush exit 2026-02-21T01:33:20.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 20 client.84265.objecter shutdown clearing up homeless session... 2026-02-21T01:33:20.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 10 client.84265.objecter successfully canceled tick 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 >> v1:10.20.193.46:6812/860801619 conn(0x7fefa803e900 legacy=0x7fefa805edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 10 monclient: shutdown 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.063+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 >> v1:10.20.193.46:6789/0 conn(0x7fefd808ddb0 legacy=0x7fefd818efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.064+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 shutdown_connections 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.064+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 >> 10.20.193.43:0/1595939494 conn(0x7fefd808f480 msgr2=0x7fefd8121530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.064+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 shutdown_connections 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.064+0000 7fefdddcf640 1 -- 10.20.193.43:0/1595939494 wait complete. 2026-02-21T01:33:20.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.064+0000 7fefdddcf640 1 librados: shutdown 2026-02-21T01:33:20.073 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:33:20.073 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:33:20.073 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:33:20.139 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.138+0000 7fb8bcc3a640 10 monclient: get_monmap_and_config 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.138+0000 7fb8bcc3a640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.138+0000 7fb8bcc3a640 10 monclient: monmap: 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:20.139777+0000 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:20.139777+0000 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.140 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:20.141 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:20.141 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.151 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.138+0000 7fb8bcc3a640 1 Processor -- start 2026-02-21T01:33:20.151 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.138+0000 7fb8bcc3a640 1 -- start start 2026-02-21T01:33:20.151 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.138+0000 7fb8bcc3a640 10 monclient: init 2026-02-21T01:33:20.151 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 10 monclient(hunting): picked mon.noname-c con 0x7fb8b808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 10 monclient(hunting): picked mon.noname-b con 0x7fb8b808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 10 monclient(hunting): picked mon.noname-a con 0x7fb8b808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b808a690 con 0x7fb8b808d8d0 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b808b910 con 0x7fb8b808ddb0 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b8088ae0 con 0x7fb8b808d4d0 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 10 monclient(hunting): authenticate will time out at 931.845191s 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b6d76640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fb8b808d8d0 0x7fb8b819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37840/0 (socket says 10.20.193.43:37840) 2026-02-21T01:33:20.152 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b6d76640 1 -- 10.20.193.43:0/697929865 learned_addr learned my addr 10.20.193.43:0/697929865 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084813162 0 0) 0x7fb8b808a690 con 0x7fb8b808d8d0 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): my global_id is 25023 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a4003610 con 0x7fb8b808d8d0 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127607385 0 0) 0x7fb8b808b910 con 0x7fb8b808ddb0 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient(hunting): my global_id is 84268 2026-02-21T01:33:20.153 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8b808a690 con 0x7fb8b808ddb0 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 641682802 0 0) 0x7fb8b808a690 con 0x7fb8b808ddb0 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 >> v1:10.20.193.43:6790/0 conn(0x7fb8b808d4d0 legacy=0x7fb8b817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 >> v1:10.20.193.43:6789/0 conn(0x7fb8b808d8d0 legacy=0x7fb8b819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 monclient: found mon.noname-c 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b81a3ef0 con 0x7fb8b808ddb0 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb8ac002df0 con 0x7fb8b808ddb0 2026-02-21T01:33:20.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 5 monclient: authenticate success, global_id 84268 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8bcc3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.139+0000 7fb8b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 10 monclient: dump: 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.155 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8ac003030 con 0x7fb8b808ddb0 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 1 -- 10.20.193.43:0/697929865 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb8ac003430 con 0x7fb8b808ddb0 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8b5573640 10 monclient: dump: 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.156 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 4 set_mon_vals no callback set 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 10 monclient: shutdown 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.157 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/697929865 >> v1:10.20.193.46:6789/0 conn(0x7fb8b808ddb0 legacy=0x7fb8b808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/697929865 shutdown_connections 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/697929865 >> 10.20.193.43:0/697929865 conn(0x7fb8b808f480 msgr2=0x7fb8b808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/697929865 shutdown_connections 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/697929865 wait complete. 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.140+0000 7fb8bcc3a640 10 monclient: monmap: 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.158 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 librados: starting msgr at 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 librados: starting objecter 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 Processor -- start 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 -- start start 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 librados: setting wanted keys 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 librados: calling monclient init 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient: init 2026-02-21T01:33:20.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient(hunting): picked mon.noname-a con 0x7fb8b808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient(hunting): picked mon.noname-c con 0x7fb8b808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient(hunting): picked mon.noname-b con 0x7fb8b808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b810cf50 con 0x7fb8b808d4d0 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b8087380 con 0x7fb8b808ddb0 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b813a8c0 con 0x7fb8b808d8d0 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient(hunting): authenticate will time out at 931.847540s 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8b6575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fb8b808d4d0 0x7fb8b8086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37848/0 (socket says 10.20.193.43:37848) 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8b6575640 1 -- 10.20.193.43:0/2054729156 learned_addr learned my addr 10.20.193.43:0/2054729156 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 client.?.objecter ms_handle_connect 0x7fb8b808d8d0 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 client.?.objecter ms_handle_connect 0x7fb8b808d4d0 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931368763 0 0) 0x7fb8b810cf50 con 0x7fb8b808d4d0 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): my global_id is 25026 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb884003610 con 0x7fb8b808d4d0 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196996468 0 0) 0x7fb8b813a8c0 con 0x7fb8b808d8d0 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): my global_id is 94100 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8b810cf50 con 0x7fb8b808d8d0 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 client.?.objecter ms_handle_connect 0x7fb8b808ddb0 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611534726 0 0) 0x7fb8b8087380 con 0x7fb8b808ddb0 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): my global_id is 84271 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8b813a8c0 con 0x7fb8b808ddb0 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3262789483 0 0) 0x7fb884003610 con 0x7fb8b808d4d0 2026-02-21T01:33:20.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8b8087380 con 0x7fb8b808d4d0 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb8ac0033c0 con 0x7fb8b808d4d0 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): dump: 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.163 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4068371442 0 0) 0x7fb8b810cf50 con 0x7fb8b808d8d0 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb884003610 con 0x7fb8b808d8d0 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb8a0002f10 con 0x7fb8b808d8d0 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient(hunting): dump: 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.164 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1792557482 0 0) 0x7fb8b8087380 con 0x7fb8b808d4d0 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.43:6790/0 conn(0x7fb8b808d8d0 legacy=0x7fb8b8086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.46:6789/0 conn(0x7fb8b808ddb0 legacy=0x7fb8b819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 monclient: found mon.a 2026-02-21T01:33:20.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b8087fb0 con 0x7fb8b808d4d0 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb89effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 5 monclient: authenticate success, global_id 25026 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient: _renew_subs 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.141+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b810cc70 con 0x7fb8b808d4d0 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8bcc3a640 10 client.25026.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8bcc3a640 10 monclient: _renew_subs 2026-02-21T01:33:20.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8bcc3a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8b811e890 con 0x7fb8b808d4d0 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8bcc3a640 1 librados: init done 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8ac003030 con 0x7fb8b808d4d0 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb8ac003a50 con 0x7fb8b808d4d0 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8b4d72640 4 set_mon_vals no callback set 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient: dump: 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.167 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8bcc3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb8b805cfb0 con 0x7fb8b81a10d0 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 client.25026.objecter ms_handle_connect 0x7fb8b81a10d0 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 client.25026.objecter resend_mon_ops 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926861332 0 0) 0x7fb8b805cfb0 con 0x7fb8b81a10d0 2026-02-21T01:33:20.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient(hunting): my global_id is 25029 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8b8087380 con 0x7fb8b81a10d0 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fb8ac003a50 con 0x7fb8b808d4d0 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(290..290 src has 1..290) ==== 4651+0+0 (unknown 2388582158 0 0) 0x7fb8ac04df00 con 0x7fb8b808d4d0 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 client.25026.objecter ms_dispatch2 0x7fb8b8000b90 osd_map(290..290 src has 1..290) 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 3 client.25026.objecter handle_osd_map got epochs [290,290] > 0 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 3 client.25026.objecter handle_osd_map decoding full epoch 290 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 20 client.25026.objecter dump_active .. 0 homeless 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3325394133 0 0) 0x7fb8b8087380 con 0x7fb8b81a10d0 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8b805cfb0 con 0x7fb8b81a10d0 2026-02-21T01:33:20.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb8a00034b0 con 0x7fb8b81a10d0 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 10 monclient: dump: 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.170 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 779157583 0 0) 0x7fb8b805cfb0 con 0x7fb8b81a10d0 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.142+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8b8057300 con 0x7fb8b81a10d0 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb8b6d76640 10 monclient: get_auth_request con 0x7fb88403e8e0 auth_method 0 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb8a0004730 con 0x7fb8b81a10d0 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb89effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb89effd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.43:6789/0 conn(0x7fb8b81a10d0 legacy=0x7fb8b8059580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.43:6789/0 conn(0x7fb8b81a10d0 legacy=0x7fb8b8059580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb8b6d76640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.46:6812/860801619 conn(0x7fb88403e8e0 legacy=0x7fb88405ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb8b6d76640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.46:6812/860801619 conn(0x7fb88403e8e0 legacy=0x7fb88405ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-21T01:33:20.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb8b6d76640 1 --1- 10.20.193.43:0/2054729156 >> v1:10.20.193.46:6812/860801619 conn(0x7fb88403e8e0 0x7fb88405ed90 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb8b6d76640 1 --1- 10.20.193.43:0/2054729156 >> v1:10.20.193.46:6812/860801619 conn(0x7fb88403e8e0 0x7fb88405ed90 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.143+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.46:6812/860801619 conn(0x7fb88403e8e0 legacy=0x7fb88405ed90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb8bcc3a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb8b811ebd0 con 0x7fb8b804ca30 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 client.25026.objecter ms_handle_connect 0x7fb8b804ca30 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 client.25026.objecter resend_mon_ops 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154821428 0 0) 0x7fb8b811ebd0 con 0x7fb8b804ca30 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient(hunting): my global_id is 25032 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8b805cfb0 con 0x7fb8b804ca30 2026-02-21T01:33:20.172 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1985365419 0 0) 0x7fb8b805cfb0 con 0x7fb8b804ca30 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8b811ebd0 con 0x7fb8b804ca30 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb8a0003a70 con 0x7fb8b804ca30 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient: dump: 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.173 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 250623118 0 0) 0x7fb8b811ebd0 con 0x7fb8b804ca30 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb8b8054ff0 con 0x7fb8b804ca30 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4318 (unknown 0 0 4209826084) 0x7fb8a0003b40 con 0x7fb8b804ca30 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.43:6789/0 conn(0x7fb8b804ca30 legacy=0x7fb8b812dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb89effd640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.43:6789/0 conn(0x7fb8b804ca30 legacy=0x7fb8b812dae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.146+0000 7fb8b6d76640 1 -- 10.20.193.43:0/2054729156 reap_dead start 2026-02-21T01:33:20.174 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 26, 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 335777, 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.175 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.176 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.177 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:20.178 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.179 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.180 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:20.181 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.182 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.183 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.184 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.185 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:20.185 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 10 librados: watch_flush enter 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 10 librados: watch_flush exit 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 20 client.25026.objecter shutdown clearing up homeless session... 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 10 client.25026.objecter successfully canceled tick 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 10 monclient: shutdown 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 >> v1:10.20.193.43:6789/0 conn(0x7fb8b808d4d0 legacy=0x7fb8b8086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 shutdown_connections 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 >> 10.20.193.43:0/2054729156 conn(0x7fb8b808f480 msgr2=0x7fb8b811f000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 shutdown_connections 2026-02-21T01:33:20.186 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 1 -- 10.20.193.43:0/2054729156 wait complete. 2026-02-21T01:33:20.187 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.147+0000 7fb8bcc3a640 1 librados: shutdown 2026-02-21T01:33:20.187 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:33:20.187 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:33:20.187 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:33:20.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient: get_monmap_and_config 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient: monmap: 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:20.256480+0000 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:20.256480+0000 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:20.266 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 1 Processor -- start 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 1 -- start start 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient: init 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient(hunting): picked mon.noname-c con 0x7f511c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient(hunting): picked mon.noname-a con 0x7f511c08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient(hunting): picked mon.noname-b con 0x7f511c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c08a690 con 0x7f511c08d4d0 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c08b910 con 0x7f511c08ddb0 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c088ae0 con 0x7f511c08d8d0 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5120cb8640 10 monclient(hunting): authenticate will time out at 931.961946s 2026-02-21T01:33:20.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.255+0000 7f5119d74640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f511c08d4d0 0x7f511c17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37868/0 (socket says 10.20.193.43:37868) 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119d74640 1 -- 10.20.193.43:0/2073397424 learned_addr learned my addr 10.20.193.43:0/2073397424 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337604442 0 0) 0x7f511c08a690 con 0x7f511c08d4d0 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): my global_id is 25035 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5108003610 con 0x7f511c08d4d0 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121251557 0 0) 0x7f511c088ae0 con 0x7f511c08d8d0 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient(hunting): my global_id is 94103 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f511c08a690 con 0x7f511c08d8d0 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452764287 0 0) 0x7f511c08a690 con 0x7f511c08d8d0 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 >> v1:10.20.193.46:6789/0 conn(0x7f511c08ddb0 legacy=0x7f511c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 >> v1:10.20.193.43:6789/0 conn(0x7f511c08d4d0 legacy=0x7f511c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 monclient: found mon.noname-b 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c1a3ef0 con 0x7f511c08d8d0 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f510c003170 con 0x7f511c08d8d0 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: dump: 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.269 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 5 monclient: authenticate success, global_id 94103 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f510c003340 con 0x7f511c08d8d0 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 1 -- 10.20.193.43:0/2073397424 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f510c003780 con 0x7f511c08d8d0 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5119573640 10 monclient: dump: 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.270 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 4 set_mon_vals no callback set 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 10 monclient: shutdown 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 1 -- 10.20.193.43:0/2073397424 >> v1:10.20.193.43:6790/0 conn(0x7f511c08d8d0 legacy=0x7f511c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 1 -- 10.20.193.43:0/2073397424 shutdown_connections 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 1 -- 10.20.193.43:0/2073397424 >> 10.20.193.43:0/2073397424 conn(0x7f511c08f480 msgr2=0x7f511c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 1 -- 10.20.193.43:0/2073397424 shutdown_connections 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.256+0000 7f5120cb8640 1 -- 10.20.193.43:0/2073397424 wait complete. 2026-02-21T01:33:20.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: monmap: 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 librados: starting msgr at 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 librados: starting objecter 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 Processor -- start 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 -- start start 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 librados: setting wanted keys 2026-02-21T01:33:20.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 librados: calling monclient init 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: init 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient(hunting): picked mon.noname-c con 0x7f511c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient(hunting): picked mon.noname-a con 0x7f511c08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient(hunting): picked mon.noname-b con 0x7f511c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c126e40 con 0x7f511c08d8d0 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c123f70 con 0x7f511c08ddb0 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c056fc0 con 0x7f511c08d4d0 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient(hunting): authenticate will time out at 931.963535s 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f511a575640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f511c08d4d0 0x7f511c123150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58778/0 (socket says 10.20.193.43:58778) 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f511a575640 1 -- 10.20.193.43:0/1396894161 learned_addr learned my addr 10.20.193.43:0/1396894161 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 client.?.objecter ms_handle_connect 0x7f511c08d8d0 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 client.?.objecter ms_handle_connect 0x7f511c08d4d0 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963634403 0 0) 0x7f511c126e40 con 0x7f511c08d8d0 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): my global_id is 25038 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e8003610 con 0x7f511c08d8d0 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746448189 0 0) 0x7f511c056fc0 con 0x7f511c08d4d0 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): my global_id is 94106 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f511c126e40 con 0x7f511c08d4d0 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2770240699 0 0) 0x7f50e8003610 con 0x7f511c08d8d0 2026-02-21T01:33:20.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f511c056fc0 con 0x7f511c08d8d0 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f51040028e0 con 0x7f511c08d8d0 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): dump: 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.275 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3705063843 0 0) 0x7f511c126e40 con 0x7f511c08d4d0 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e8003610 con 0x7f511c08d4d0 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5110003110 con 0x7f511c08d4d0 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient(hunting): dump: 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.276 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1412738596 0 0) 0x7f511c056fc0 con 0x7f511c08d8d0 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.43:6790/0 conn(0x7f511c08d4d0 legacy=0x7f511c123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.46:6789/0 conn(0x7f511c08ddb0 legacy=0x7f511c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 monclient: found mon.a 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c05e1b0 con 0x7f511c08d8d0 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 5 monclient: authenticate success, global_id 25038 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: _renew_subs 2026-02-21T01:33:20.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f511c124ae0 con 0x7f511c08d8d0 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 client.25038.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: _renew_subs 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f511c1258b0 con 0x7f511c08d8d0 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5120cb8640 1 librados: init done 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51040048d0 con 0x7f511c08d8d0 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5104004c20 con 0x7f511c08d8d0 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5102ffd640 10 monclient: dump: 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.278 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.257+0000 7f5118d72640 4 set_mon_vals no callback set 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5120cb8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f511c08edd0 con 0x7f511c1272c0 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 client.25038.objecter ms_handle_connect 0x7f511c1272c0 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 client.25038.objecter resend_mon_ops 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318471669 0 0) 0x7f511c08edd0 con 0x7f511c1272c0 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient(hunting): my global_id is 94109 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f511c056fc0 con 0x7f511c1272c0 2026-02-21T01:33:20.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1416872584 0 0) 0x7f511c056fc0 con 0x7f511c1272c0 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f511c08edd0 con 0x7f511c1272c0 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5110003910 con 0x7f511c1272c0 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient: dump: 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f51040115a0 con 0x7f511c08d8d0 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1272613637 0 0) 0x7f511c08edd0 con 0x7f511c1272c0 2026-02-21T01:33:20.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f511c126730 con 0x7f511c1272c0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(290..290 src has 1..290) ==== 4651+0+0 (unknown 2388582158 0 0) 0x7f510404e100 con 0x7f511c08d8d0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 client.25038.objecter ms_dispatch2 0x7f511c000b90 osd_map(290..290 src has 1..290) 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 3 client.25038.objecter handle_osd_map got epochs [290,290] > 0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 3 client.25038.objecter handle_osd_map decoding full epoch 290 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 20 client.25038.objecter dump_active .. 0 homeless 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f511ad76640 10 monclient: get_auth_request con 0x7f50e803e9e0 auth_method 0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f51100058b0 con 0x7f511c1272c0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.43:6790/0 conn(0x7f511c1272c0 legacy=0x7f511c11fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.258+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.43:6790/0 conn(0x7f511c1272c0 legacy=0x7f511c11fa70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.259+0000 7f5102ffd640 10 client.25038.objecter ms_handle_connect 0x7f50e803e9e0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5120cb8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f511c120890 con 0x7f511c1a10d0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 client.25038.objecter ms_handle_connect 0x7f511c1a10d0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 client.25038.objecter resend_mon_ops 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555218437 0 0) 0x7f511c120890 con 0x7f511c1a10d0 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient(hunting): my global_id is 94112 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f511c08edd0 con 0x7f511c1a10d0 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1867806488 0 0) 0x7f511c08edd0 con 0x7f511c1a10d0 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f511c120890 con 0x7f511c1a10d0 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5110004230 con 0x7f511c1a10d0 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient: dump: 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.282 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1318693882 0 0) 0x7f511c120890 con 0x7f511c1a10d0 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f511c113b50 con 0x7f511c1a10d0 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4146 (unknown 0 0 3824315363) 0x7f5110004050 con 0x7f511c1a10d0 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.43:6790/0 conn(0x7f511c1a10d0 legacy=0x7f511c120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.262+0000 7f5102ffd640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.43:6790/0 conn(0x7f511c1a10d0 legacy=0x7f511c120180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:20.283 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 26, 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 367, 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.284 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.285 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:20.286 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.287 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.288 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:20.289 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.290 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:20.291 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 10 librados: watch_flush enter 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 10 librados: watch_flush exit 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 20 client.25038.objecter shutdown clearing up homeless session... 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 10 client.25038.objecter successfully canceled tick 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.46:6812/860801619 conn(0x7f50e803e9e0 legacy=0x7f50e805ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 10 monclient: shutdown 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 >> v1:10.20.193.43:6789/0 conn(0x7f511c08d8d0 legacy=0x7f511c123860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f511ad76640 1 -- 10.20.193.43:0/1396894161 reap_dead start 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f511ad76640 1 -- 10.20.193.43:0/1396894161 reap_dead start 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 shutdown_connections 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 >> 10.20.193.43:0/1396894161 conn(0x7f511c08f480 msgr2=0x7f511c1a2710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 shutdown_connections 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 1 -- 10.20.193.43:0/1396894161 wait complete. 2026-02-21T01:33:20.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.263+0000 7f5120cb8640 1 librados: shutdown 2026-02-21T01:33:20.294 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:33:20.294 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:33:20.294 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:33:20.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient: get_monmap_and_config 2026-02-21T01:33:20.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.360 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient: monmap: 2026-02-21T01:33:20.360 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:20.360635+0000 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:20.360635+0000 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:20.361 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.367 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 1 Processor -- start 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 1 -- start start 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient: init 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient(hunting): picked mon.noname-a con 0x7efcc0038ed0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient(hunting): picked mon.noname-b con 0x7efcc008ee60 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.359+0000 7efcc7609640 10 monclient(hunting): picked mon.noname-c con 0x7efcc013f5b0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc00392a0 con 0x7efcc0038ed0 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc005dbb0 con 0x7efcc013f5b0 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc005de90 con 0x7efcc008ee60 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 10 monclient(hunting): authenticate will time out at 932.066024s 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc537e640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7efcc0038ed0 0x7efcc008b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37894/0 (socket says 10.20.193.43:37894) 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc537e640 1 -- 10.20.193.43:0/4118368042 learned_addr learned my addr 10.20.193.43:0/4118368042 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120361081 0 0) 0x7efcc00392a0 con 0x7efcc0038ed0 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): my global_id is 25041 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca8003610 con 0x7efcc0038ed0 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645081001 0 0) 0x7efcc005de90 con 0x7efcc008ee60 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient(hunting): my global_id is 94115 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc00392a0 con 0x7efcc008ee60 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 498793219 0 0) 0x7efca8003610 con 0x7efcc0038ed0 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 >> v1:10.20.193.43:6790/0 conn(0x7efcc008ee60 legacy=0x7efcc0180400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 >> v1:10.20.193.46:6789/0 conn(0x7efcc013f5b0 legacy=0x7efcc01a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 monclient: found mon.noname-a 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc005e170 con 0x7efcc0038ed0 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efcb0002df0 con 0x7efcc0038ed0 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: dump: 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.370 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 5 monclient: authenticate success, global_id 25041 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcb0003000 con 0x7efcc0038ed0 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 1 -- 10.20.193.43:0/4118368042 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efcb0003440 con 0x7efcc0038ed0 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcaffff640 10 monclient: dump: 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.371 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 4 set_mon_vals no callback set 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 10 monclient: shutdown 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- 10.20.193.43:0/4118368042 >> v1:10.20.193.43:6789/0 conn(0x7efcc0038ed0 legacy=0x7efcc008b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- 10.20.193.43:0/4118368042 shutdown_connections 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- 10.20.193.43:0/4118368042 >> 10.20.193.43:0/4118368042 conn(0x7efcc008c8e0 msgr2=0x7efcc008d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- 10.20.193.43:0/4118368042 shutdown_connections 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.360+0000 7efcc7609640 1 -- 10.20.193.43:0/4118368042 wait complete. 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient: monmap: 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:20.372 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 librados: starting msgr at 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 librados: starting objecter 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 Processor -- start 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 -- start start 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 librados: setting wanted keys 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 librados: calling monclient init 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient: init 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient(hunting): picked mon.noname-a con 0x7efcc0038ed0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient(hunting): picked mon.noname-b con 0x7efcc008ee60 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient(hunting): picked mon.noname-c con 0x7efcc013f5b0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc00895c0 con 0x7efcc0038ed0 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc00869a0 con 0x7efcc008ee60 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc01371e0 con 0x7efcc013f5b0 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc7609640 10 monclient(hunting): authenticate will time out at 932.067772s 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc537e640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7efcc0038ed0 0x7efcc014f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37910/0 (socket says 10.20.193.43:37910) 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcc537e640 1 -- 10.20.193.43:0/2155860734 learned_addr learned my addr 10.20.193.43:0/2155860734 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 client.?.objecter ms_handle_connect 0x7efcc0038ed0 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 client.?.objecter ms_handle_connect 0x7efcc013f5b0 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543824783 0 0) 0x7efcc01371e0 con 0x7efcc013f5b0 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): my global_id is 94118 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc90003610 con 0x7efcc013f5b0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144081906 0 0) 0x7efcc00895c0 con 0x7efcc0038ed0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 10 monclient(hunting): my global_id is 25044 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.361+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc01371e0 con 0x7efcc0038ed0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3885255444 0 0) 0x7efc90003610 con 0x7efcc013f5b0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcc00895c0 con 0x7efcc013f5b0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 client.?.objecter ms_handle_connect 0x7efcc008ee60 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3924267795 0 0) 0x7efcc01371e0 con 0x7efcc0038ed0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc90003610 con 0x7efcc0038ed0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efcbc003040 con 0x7efcc013f5b0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient(hunting): dump: 2026-02-21T01:33:20.375 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efcb0003350 con 0x7efcc0038ed0 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient(hunting): dump: 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.376 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 782190412 0 0) 0x7efcc00895c0 con 0x7efcc013f5b0 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.46:6789/0 conn(0x7efcc008ee60 legacy=0x7efcc0190730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.43:6789/0 conn(0x7efcc0038ed0 legacy=0x7efcc014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 monclient: found mon.c 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc0139540 con 0x7efcc013f5b0 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 5 monclient: authenticate success, global_id 94118 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 10 monclient: _renew_subs 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efcc013c9d0 con 0x7efcc013f5b0 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 10 client.94118.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 10 monclient: _renew_subs 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efcc01367d0 con 0x7efcc013f5b0 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 1 librados: init done 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcbc0031e0 con 0x7efcc013f5b0 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efcbc003cb0 con 0x7efcc013f5b0 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 monclient: dump: 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.378 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcaf7fe640 4 set_mon_vals no callback set 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7efcbc010630 con 0x7efcc013f5b0 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efcc00893c0 con 0x7efcc014fc40 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(290..290 src has 1..290) ==== 4651+0+0 (unknown 2388582158 0 0) 0x7efcbc04d1f0 con 0x7efcc013f5b0 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 10 client.94118.objecter ms_dispatch2 0x7efcc0000b90 osd_map(290..290 src has 1..290) 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 3 client.94118.objecter handle_osd_map got epochs [290,290] > 0 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 3 client.94118.objecter handle_osd_map decoding full epoch 290 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.362+0000 7efcadffb640 20 client.94118.objecter dump_active .. 0 homeless 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcc4b7d640 10 monclient: get_auth_request con 0x7efc9003e9e0 auth_method 0 2026-02-21T01:33:20.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 client.94118.objecter ms_handle_connect 0x7efc9003e9e0 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 client.94118.objecter ms_handle_connect 0x7efcc014fc40 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 client.94118.objecter resend_mon_ops 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131965171 0 0) 0x7efc90003610 con 0x7efcc014fc40 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient(hunting): my global_id is 84277 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc00895c0 con 0x7efcc014fc40 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 103015122 0 0) 0x7efcc00895c0 con 0x7efcc014fc40 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc90003610 con 0x7efcc014fc40 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efcb0004a30 con 0x7efcc014fc40 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient: dump: 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.380 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 5533320 0 0) 0x7efc90003610 con 0x7efcc014fc40 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efcc0139110 con 0x7efcc014fc40 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7efcb0004d50 con 0x7efcc014fc40 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.46:6789/0 conn(0x7efcc014fc40 legacy=0x7efcc00836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.363+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.46:6789/0 conn(0x7efcc014fc40 legacy=0x7efcc00836b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:20.382 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.367+0000 7efcc7609640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.367+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efcc0136b60 con 0x7efcc0083dc0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.367+0000 7efcadffb640 10 client.94118.objecter ms_handle_connect 0x7efcc0083dc0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.367+0000 7efcadffb640 10 client.94118.objecter resend_mon_ops 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558473822 0 0) 0x7efcc0136b60 con 0x7efcc0083dc0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient(hunting): my global_id is 84280 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc90003610 con 0x7efcc0083dc0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3392462867 0 0) 0x7efc90003610 con 0x7efcc0083dc0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcc0136b60 con 0x7efcc0083dc0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7efcb0006380 con 0x7efcc0083dc0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient: dump: 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.383 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1146931125 0 0) 0x7efcc0136b60 con 0x7efcc0083dc0 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efcc008d180 con 0x7efcc0083dc0 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4483 (unknown 0 0 2673953895) 0x7efcb00064d0 con 0x7efcc0083dc0 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.46:6789/0 conn(0x7efcc0083dc0 legacy=0x7efcc0194580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcadffb640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.46:6789/0 conn(0x7efcc0083dc0 legacy=0x7efcc0194580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 26, 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 107385, 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:20.385 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:20.386 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:20.387 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:20.388 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:20.389 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:20.390 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:20.391 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.392 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:33:20.393 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:20.394 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:20.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 10 librados: watch_flush enter 2026-02-21T01:33:20.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 10 librados: watch_flush exit 2026-02-21T01:33:20.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 20 client.94118.objecter shutdown clearing up homeless session... 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 10 client.94118.objecter successfully canceled tick 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.46:6812/860801619 conn(0x7efc9003e9e0 legacy=0x7efc9005ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 10 monclient: shutdown 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 >> v1:10.20.193.43:6790/0 conn(0x7efcc013f5b0 legacy=0x7efcc0191e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc5b7f640 1 -- 10.20.193.43:0/2155860734 reap_dead start 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc5b7f640 1 -- 10.20.193.43:0/2155860734 reap_dead start 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 shutdown_connections 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 >> 10.20.193.43:0/2155860734 conn(0x7efcc008c8e0 msgr2=0x7efcc008b680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 shutdown_connections 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 1 -- 10.20.193.43:0/2155860734 wait complete. 2026-02-21T01:33:20.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.368+0000 7efcc7609640 1 librados: shutdown 2026-02-21T01:33:20.396 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:33:20.396 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-21T01:33:20.397 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.464+0000 7f9d8f2b8640 10 monclient: get_monmap_and_config 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.464+0000 7f9d8f2b8640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient: monmap: 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:20.466359+0000 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:20.466359+0000 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:20.466 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:20.467 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 1 Processor -- start 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 1 -- start start 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient: init 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient(hunting): picked mon.noname-a con 0x7f9d8808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient(hunting): picked mon.noname-c con 0x7f9d8808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient(hunting): picked mon.noname-b con 0x7f9d8808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8808a690 con 0x7f9d8808ddb0 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8808b910 con 0x7f9d8808d4d0 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d88088ae0 con 0x7f9d8808d8d0 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8f2b8640 10 monclient(hunting): authenticate will time out at 932.171765s 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8d02d640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f9d8808ddb0 0x7f9d8808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37926/0 (socket says 10.20.193.43:37926) 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8d82e640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f9d8808d8d0 0x7f9d8819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58814/0 (socket says 10.20.193.43:58814) 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d8d02d640 1 -- 10.20.193.43:0/4082981333 learned_addr learned my addr 10.20.193.43:0/4082981333 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.465+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1624759443 0 0) 0x7f9d88088ae0 con 0x7f9d8808d8d0 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): my global_id is 94121 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d70003610 con 0x7f9d8808d8d0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643957802 0 0) 0x7f9d8808a690 con 0x7f9d8808ddb0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): my global_id is 25047 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d88088ae0 con 0x7f9d8808ddb0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394302838 0 0) 0x7f9d8808b910 con 0x7f9d8808d4d0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient(hunting): my global_id is 84283 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d8808a690 con 0x7f9d8808d4d0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4224725062 0 0) 0x7f9d70003610 con 0x7f9d8808d8d0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 >> v1:10.20.193.46:6789/0 conn(0x7f9d8808d4d0 legacy=0x7f9d8817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 >> v1:10.20.193.43:6789/0 conn(0x7f9d8808ddb0 legacy=0x7f9d8808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 monclient: found mon.noname-b 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d881a3ef0 con 0x7f9d8808d8d0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9d84003170 con 0x7f9d8808d8d0 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 5 monclient: authenticate success, global_id 94121 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:20.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: dump: 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d84003430 con 0x7f9d8808d8d0 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 1 -- 10.20.193.43:0/4082981333 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9d84003870 con 0x7f9d8808d8d0 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 4 set_mon_vals no callback set 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d77fff640 10 monclient: dump: 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.473 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 10 monclient: shutdown 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/4082981333 >> v1:10.20.193.43:6790/0 conn(0x7f9d8808d8d0 legacy=0x7f9d8819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/4082981333 shutdown_connections 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/4082981333 >> 10.20.193.43:0/4082981333 conn(0x7f9d8808f480 msgr2=0x7f9d8808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/4082981333 shutdown_connections 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/4082981333 wait complete. 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 10 monclient: build_initial_monmap 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 10 monclient: monmap: 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 1 librados: starting msgr at 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.466+0000 7f9d8f2b8640 1 librados: starting objecter 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 Processor -- start 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 -- start start 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 librados: setting wanted keys 2026-02-21T01:33:20.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 librados: calling monclient init 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient: init 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient(hunting): picked mon.noname-b con 0x7f9d8808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient(hunting): picked mon.noname-a con 0x7f9d8808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient(hunting): picked mon.noname-c con 0x7f9d8808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d881064d0 con 0x7f9d8808d8d0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8805e1b0 con 0x7f9d8808d4d0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8811c690 con 0x7f9d8808ddb0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient(hunting): authenticate will time out at 932.173337s 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8d82e640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f9d8808ddb0 0x7f9d8819b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58826/0 (socket says 10.20.193.43:58826) 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8c82c640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f9d8808d8d0 0x7f9d88105dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:37940/0 (socket says 10.20.193.43:37940) 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8d82e640 1 -- 10.20.193.43:0/175488147 learned_addr learned my addr 10.20.193.43:0/175488147 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 client.?.objecter ms_handle_connect 0x7f9d8808ddb0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 client.?.objecter ms_handle_connect 0x7f9d8808d8d0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29980706 0 0) 0x7f9d8811c690 con 0x7f9d8808ddb0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): my global_id is 94124 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d58003610 con 0x7f9d8808ddb0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 client.?.objecter ms_handle_connect 0x7f9d8808d4d0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123242373 0 0) 0x7f9d881064d0 con 0x7f9d8808d8d0 2026-02-21T01:33:20.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): my global_id is 25050 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d8811c690 con 0x7f9d8808d8d0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1372537316 0 0) 0x7f9d58003610 con 0x7f9d8808ddb0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d881064d0 con 0x7f9d8808ddb0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9d84003130 con 0x7f9d8808ddb0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 573797425 0 0) 0x7f9d8811c690 con 0x7f9d8808d8d0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d58003610 con 0x7f9d8808d8d0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9d7c0030b0 con 0x7f9d8808d8d0 2026-02-21T01:33:20.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998102133 0 0) 0x7f9d8805e1b0 con 0x7f9d8808d4d0 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient(hunting): my global_id is 84286 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d8811c690 con 0x7f9d8808d4d0 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3635973798 0 0) 0x7f9d881064d0 con 0x7f9d8808ddb0 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 >> v1:10.20.193.46:6789/0 conn(0x7f9d8808d4d0 legacy=0x7f9d881056b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 >> v1:10.20.193.43:6789/0 conn(0x7f9d8808d8d0 legacy=0x7f9d88105dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 monclient: found mon.c 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d88106f60 con 0x7f9d8808ddb0 2026-02-21T01:33:20.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: _finish_auth 0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 5 monclient: authenticate success, global_id 94124 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient: _renew_subs 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d88108140 con 0x7f9d8808ddb0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 client.94124.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient: _renew_subs 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d881071e0 con 0x7f9d8808ddb0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d8f2b8640 1 librados: init done 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d84004fe0 con 0x7f9d8808ddb0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9d84005330 con 0x7f9d8808ddb0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d75ffb640 10 monclient: dump: 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.467+0000 7f9d777fe640 4 set_mon_vals no callback set 2026-02-21T01:33:20.478 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d8f2b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d8f2b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d8f2b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8808edd0 con 0x7f9d8808ddb0 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f9d84011cb0 con 0x7f9d8808ddb0 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(291..291 src has 1..291) ==== 4757+0+0 (unknown 3965050262 0 0) 0x7f9d8404e470 con 0x7f9d8808ddb0 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d75ffb640 10 client.94124.objecter ms_dispatch2 0x7f9d88000b90 osd_map(291..291 src has 1..291) 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d75ffb640 3 client.94124.objecter handle_osd_map got epochs [291,291] > 0 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d75ffb640 3 client.94124.objecter handle_osd_map decoding full epoch 291 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d75ffb640 20 client.94124.objecter dump_active .. 0 homeless 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.468+0000 7f9d8d02d640 10 monclient: get_auth_request con 0x7f9d5803eb00 auth_method 0 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.469+0000 7f9d75ffb640 10 client.94124.objecter ms_handle_connect 0x7f9d5803eb00 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.470+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9d84017a50 con 0x7f9d8808ddb0 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.470+0000 7f9d75ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:20.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.470+0000 7f9d75ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:20.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.623+0000 7f9d8f2b8640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-21T01:33:20.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.623+0000 7f9d8f2b8640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-21T01:33:20.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.623+0000 7f9d8f2b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:20.624 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.623+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f9d88107520 con 0x7f9d8808ddb0 2026-02-21T01:33:20.625 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.625 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=13,kv=7,logm=62} crc {auth=1263439585,config=3140514009,health=2716147082,kv=3884596044,logm=1049264476}) 2026-02-21T01:33:20.625 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=13,kv=10,logm=60} crc {auth=1906539308,config=3140514009,health=2716147082,kv=1200173230,logm=858423893}) 2026-02-21T01:33:20.625 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.625 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=13,kv=7,logm=62} crc {auth=1263439585,config=3140514009,health=2716147082,kv=3884596044,logm=1049264476}) 2026-02-21T01:33:20.625 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=10,kv=10,logm=63} crc {auth=2394655492,config=3140514009,health=1281764270,kv=1200173230,logm=2632798398}) 2026-02-21T01:33:20.625 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.624+0000 7f9d75ffb640 1 -- 10.20.193.43:0/175488147 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f9d8401c970 con 0x7f9d8808ddb0 2026-02-21T01:33:20.625 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.624+0000 7f9d75ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-21T01:33:20.625 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.624+0000 7f9d75ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:20.625 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3172750919}) 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2562636573}) 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3172750919}) 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.624+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1406066115}) 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985709508}) 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3723464404}) 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1985709508}) 2026-02-21T01:33:20.626 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1072742985}) 2026-02-21T01:33:20.626 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 10 librados: watch_flush enter 2026-02-21T01:33:20.626 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 10 librados: watch_flush exit 2026-02-21T01:33:20.626 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 20 client.94124.objecter shutdown clearing up homeless session... 2026-02-21T01:33:20.626 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 10 client.94124.objecter successfully canceled tick 2026-02-21T01:33:20.627 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.627 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=88104710}) 2026-02-21T01:33:20.627 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2217110033}) 2026-02-21T01:33:20.627 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.627 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=88104710}) 2026-02-21T01:33:20.627 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2306888286}) 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 >> v1:10.20.193.46:6812/860801619 conn(0x7f9d5803eb00 legacy=0x7f9d5805efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 10 monclient: shutdown 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 >> v1:10.20.193.43:6790/0 conn(0x7f9d8808ddb0 legacy=0x7f9d8819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 shutdown_connections 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 >> 10.20.193.43:0/175488147 conn(0x7f9d8808f480 msgr2=0x7f9d8811ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 shutdown_connections 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 1 -- 10.20.193.43:0/175488147 wait complete. 2026-02-21T01:33:20.627 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:20.625+0000 7f9d8f2b8640 1 librados: shutdown 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1407046544}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1676176821}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1407046544}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.625+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3503295340}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3976912736}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1836287208}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3976912736}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2223571862}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043715015}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3439325374}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043715015}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.626+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1098958949}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447091280}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4193888917}) 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.628 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447091280}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1692547557}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=746482898}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4020308788}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=746482898}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2103724913}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965087183}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3630276208}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1965087183}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.627+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1096454956}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3298946633}) 2026-02-21T01:33:20.629 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1801422146}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3298946633}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3669010539}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=612872241}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2222383100}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=612872241}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2823457385}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1414400963}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4169714170}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1414400963}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.628+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=534357719}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2020245026}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3160263084}) 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.630 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2020245026}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2125665156}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351022481}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3608147306}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351022481}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.629+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3459568622}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406590548}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2882926710}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406590548}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2778064033}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614077093}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3287632084}) 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.631 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614077093}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=185879005}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335076694}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1952930906}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3335076694}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.630+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2383198733}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2401215004}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1797941084}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2401215004}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2896322678}) 2026-02-21T01:33:20.632 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=116327266}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1689129753}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=116327266}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=33322652}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=673121942}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=409969160}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=673121942}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.631+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=410973269}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107203377}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=157572148}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107203377}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3619498307}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361846196}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2923377128}) 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.633 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361846196}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=79714115}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3604169849}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4137348489}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3604169849}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.632+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=502206396}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=378470113}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=536640714}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=378470113}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2150134623}) 2026-02-21T01:33:20.634 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2861514855}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3021774519}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2861514855}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4109577490}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2447624978}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2436179747}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2447624978}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.633+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1661724436}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=3649507435,mdsmap=3068764153,mgr=2369323924}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=1371508614,mdsmap=3068764153,mgr=866546090}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=3649507435,mdsmap=3068764153,mgr=2369323924}) 2026-02-21T01:33:20.635 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=90,mdsmap=2,mgr=8} crc {logm=2022115209,mdsmap=1655407333,mgr=2204815247}) 2026-02-21T01:33:20.636 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=1,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=51} crc {mgr=1747058506,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=3307339561,mon_config_key=403450563,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=144405051,osd_snap=3051630146,osdmap=4213768566}) 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=1,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=17,osdmap=51} crc {mgr=1747058506,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=1328821197,mon_config_key=1885151249,monmap=4257464702,nvmeofgw=935146538,osd_metadata=2108339561,osd_pg_creating=144405051,osd_snap=959299229,osdmap=409119026}) 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=1,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=51} crc {mgr=1747058506,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=3307339561,mon_config_key=403450563,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=144405051,osd_snap=3051630146,osdmap=4213768566}) 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.634+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=17,osdmap=50} crc {mgr=1747058506,mgr_metadata=883221768,mgrstat=3307339561,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=144405051,osd_snap=970923085,osdmap=939586445}) 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4290515615}) 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=481732598}) 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4290515615}) 2026-02-21T01:33:20.636 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=735231224}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2000595433}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3100684735}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2000595433}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.635+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2387574127}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.636+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.636+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1493728479}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.636+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=88394159}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.636+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.636+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1493728479}) 2026-02-21T01:33:20.637 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.636+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1595458111}) 2026-02-21T01:33:20.638 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.637+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.638 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.637+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=76} crc {osdmap=363175026}) 2026-02-21T01:33:20.638 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.637+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=82} crc {osdmap=1391926744}) 2026-02-21T01:33:20.638 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.637+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:33:20.638 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.637+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=76} crc {osdmap=363175026}) 2026-02-21T01:33:20.638 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:33:20.637+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=81} crc {osdmap=433321310}) 2026-02-21T01:33:21.636 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:33:21.636 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:33:21.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.703+0000 7f15c3755640 10 monclient: get_monmap_and_config 2026-02-21T01:33:21.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.703+0000 7f15c3755640 10 monclient: build_initial_monmap 2026-02-21T01:33:21.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.703+0000 7f15c3755640 10 monclient: monmap: 2026-02-21T01:33:21.711 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:21.711 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.711 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:21.704728+0000 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:21.704728+0000 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.703+0000 7f15c3755640 1 Processor -- start 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.703+0000 7f15c3755640 1 -- start start 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.703+0000 7f15c3755640 10 monclient: init 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:21.712 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient(hunting): picked mon.noname-b con 0x7f15bc0890e0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient(hunting): picked mon.noname-a con 0x7f15bc08a170 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient(hunting): picked mon.noname-c con 0x7f15bc08a540 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc087750 con 0x7f15bc08a170 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc087a30 con 0x7f15bc08a540 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc086560 con 0x7f15bc0890e0 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient(hunting): authenticate will time out at 933.410183s 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c14ca640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f15bc0890e0 0x7f15bc089a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:48520/0 (socket says 10.20.193.43:48520) 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c14ca640 1 -- 10.20.193.43:0/3227660066 learned_addr learned my addr 10.20.193.43:0/3227660066 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c0cc9640 1 --1- 10.20.193.43:0/3227660066 >> v1:10.20.193.43:6789/0 conn(0x7f15bc08a170 0x7f15bc17d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53844/0 (socket says 10.20.193.43:53844) 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924493186 0 0) 0x7f15bc086560 con 0x7f15bc0890e0 2026-02-21T01:33:21.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): my global_id is 94127 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a4003610 con 0x7f15bc0890e0 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270874983 0 0) 0x7f15bc087750 con 0x7f15bc08a170 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient(hunting): my global_id is 25053 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15bc086560 con 0x7f15bc08a170 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4010771589 0 0) 0x7f15a4003610 con 0x7f15bc0890e0 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 >> v1:10.20.193.46:6789/0 conn(0x7f15bc08a540 legacy=0x7f15bc19ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 >> v1:10.20.193.43:6789/0 conn(0x7f15bc08a170 legacy=0x7f15bc17d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 monclient: found mon.noname-b 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc08af90 con 0x7f15bc0890e0 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: _finish_auth 0 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15ac002df0 con 0x7f15bc0890e0 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 5 monclient: authenticate success, global_id 94127 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: dump: 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15ac002fc0 con 0x7f15bc0890e0 2026-02-21T01:33:21.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 1 -- 10.20.193.43:0/3227660066 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15ac003400 con 0x7f15bc0890e0 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15abfff640 10 monclient: dump: 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.717 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.704+0000 7f15c3755640 4 set_mon_vals no callback set 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient: shutdown 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 -- 10.20.193.43:0/3227660066 >> v1:10.20.193.43:6790/0 conn(0x7f15bc0890e0 legacy=0x7f15bc089a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 -- 10.20.193.43:0/3227660066 shutdown_connections 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 -- 10.20.193.43:0/3227660066 >> 10.20.193.43:0/3227660066 conn(0x7f15bc08f480 msgr2=0x7f15bc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 -- 10.20.193.43:0/3227660066 shutdown_connections 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 -- 10.20.193.43:0/3227660066 wait complete. 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient: build_initial_monmap 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient: monmap: 2026-02-21T01:33:21.718 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 librados: starting msgr at 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 librados: starting objecter 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 Processor -- start 2026-02-21T01:33:21.719 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 -- start start 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 librados: setting wanted keys 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 librados: calling monclient init 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient: init 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient(hunting): picked mon.noname-a con 0x7f15bc0890e0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient(hunting): picked mon.noname-b con 0x7f15bc08a170 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 10 monclient(hunting): picked mon.noname-c con 0x7f15bc08a540 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.705+0000 7f15c3755640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc1a54c0 con 0x7f15bc0890e0 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc191900 con 0x7f15bc08a170 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc05e1b0 con 0x7f15bc08a540 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient(hunting): authenticate will time out at 933.412026s 2026-02-21T01:33:21.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c14ca640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f15bc0890e0 0x7f15bc18e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53848/0 (socket says 10.20.193.43:53848) 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c14ca640 1 -- 10.20.193.43:0/2278758549 learned_addr learned my addr 10.20.193.43:0/2278758549 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 client.?.objecter ms_handle_connect 0x7f15bc0890e0 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 client.?.objecter ms_handle_connect 0x7f15bc08a540 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231839635 0 0) 0x7f15bc1a54c0 con 0x7f15bc0890e0 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): my global_id is 25056 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158c003610 con 0x7f15bc0890e0 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516371960 0 0) 0x7f15bc05e1b0 con 0x7f15bc08a540 2026-02-21T01:33:21.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): my global_id is 94130 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15bc1a54c0 con 0x7f15bc08a540 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4248689662 0 0) 0x7f158c003610 con 0x7f15bc0890e0 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15bc05e1b0 con 0x7f15bc0890e0 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3162993691 0 0) 0x7f15bc1a54c0 con 0x7f15bc08a540 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f158c003610 con 0x7f15bc08a540 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15ac0033d0 con 0x7f15bc0890e0 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.722 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15b8003290 con 0x7f15bc08a540 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:21.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 client.?.objecter ms_handle_connect 0x7f15bc08a170 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:21.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 291742663 0 0) 0x7f15bc05e1b0 con 0x7f15bc0890e0 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 >> v1:10.20.193.43:6790/0 conn(0x7f15bc08a540 legacy=0x7f15bc18f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 >> v1:10.20.193.46:6789/0 conn(0x7f15bc08a170 legacy=0x7f15bc18f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 monclient: found mon.a 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc190410 con 0x7f15bc0890e0 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: _finish_auth 0 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 5 monclient: authenticate success, global_id 25056 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient: _renew_subs 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc192770 con 0x7f15bc0890e0 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 client.25056.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient: _renew_subs 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f15bc237a00 con 0x7f15bc0890e0 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15ac004b80 con 0x7f15bc0890e0 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 1 librados: init done 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15ac004f90 con 0x7f15bc0890e0 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 10 monclient: dump: 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.726 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15ab7fe640 4 set_mon_vals no callback set 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc088ab0 con 0x7f15bc0890e0 2026-02-21T01:33:21.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.706+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f15ac0051b0 con 0x7f15bc0890e0 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.707+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(292..292 src has 1..292) ==== 5171+0+0 (unknown 1831276532 0 0) 0x7f15ac04e4f0 con 0x7f15bc0890e0 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.707+0000 7f15a9ffb640 10 client.25056.objecter ms_dispatch2 0x7f15bc000b90 osd_map(292..292 src has 1..292) 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.707+0000 7f15a9ffb640 3 client.25056.objecter handle_osd_map got epochs [292,292] > 0 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.707+0000 7f15a9ffb640 3 client.25056.objecter handle_osd_map decoding full epoch 292 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.707+0000 7f15a9ffb640 20 client.25056.objecter dump_active .. 0 homeless 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.707+0000 7f15c0cc9640 10 monclient: get_auth_request con 0x7f158c03e9a0 auth_method 0 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.707+0000 7f15a9ffb640 10 client.25056.objecter ms_handle_connect 0x7f158c03e9a0 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.709+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f15ac0177c0 con 0x7f15bc0890e0 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.709+0000 7f15a9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:21.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.709+0000 7f15a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:21.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.858+0000 7f15c3755640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:33:21.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.858+0000 7f15c3755640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:21.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.858+0000 7f15c3755640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.858+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f15bc054ff0 con 0x7f15bc0890e0 2026-02-21T01:33:21.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.858+0000 7f15a9ffb640 1 -- 10.20.193.43:0/2278758549 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 305319106) 0x7f15ac01c740 con 0x7f15bc0890e0 2026-02-21T01:33:21.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.858+0000 7f15a9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:21.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.858+0000 7f15a9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:21.861 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 10 librados: watch_flush enter 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 10 librados: watch_flush exit 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 20 client.25056.objecter shutdown clearing up homeless session... 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 10 client.25056.objecter successfully canceled tick 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 >> v1:10.20.193.46:6812/860801619 conn(0x7f158c03e9a0 legacy=0x7f158c05ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 10 monclient: shutdown 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 >> v1:10.20.193.43:6789/0 conn(0x7f15bc0890e0 legacy=0x7f15bc18e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 shutdown_connections 2026-02-21T01:33:21.862 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 >> 10.20.193.43:0/2278758549 conn(0x7f15bc08f480 msgr2=0x7f15bc05b650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:21.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 shutdown_connections 2026-02-21T01:33:21.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 1 -- 10.20.193.43:0/2278758549 wait complete. 2026-02-21T01:33:21.863 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.859+0000 7f15c3755640 1 librados: shutdown 2026-02-21T01:33:21.867 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:33:21.867 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-21T01:33:21.867 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:33:21.868 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:33:21.947 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.934+0000 7f313f4d0640 10 monclient: get_monmap_and_config 2026-02-21T01:33:21.947 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.934+0000 7f313f4d0640 10 monclient: build_initial_monmap 2026-02-21T01:33:21.947 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.934+0000 7f313f4d0640 10 monclient: monmap: 2026-02-21T01:33:21.947 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:21.947 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.947 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:21.936239+0000 2026-02-21T01:33:21.947 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:21.936239+0000 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 1 Processor -- start 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 1 -- start start 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient: init 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient(hunting): picked mon.noname-a con 0x7f313808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient(hunting): picked mon.noname-b con 0x7f313808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient(hunting): picked mon.noname-c con 0x7f313808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313808a690 con 0x7f313808ddb0 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313808b910 con 0x7f313808d8d0 2026-02-21T01:33:21.948 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3138088ae0 con 0x7f313808d4d0 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313f4d0640 10 monclient(hunting): authenticate will time out at 933.641634s 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313d245640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f313808ddb0 0x7f313808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53850/0 (socket says 10.20.193.43:53850) 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313ca44640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f313808d4d0 0x7f313817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:48546/0 (socket says 10.20.193.43:48546) 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f313d245640 1 -- 10.20.193.43:0/695347 learned_addr learned my addr 10.20.193.43:0/695347 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746556201 0 0) 0x7f3138088ae0 con 0x7f313808d4d0 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): my global_id is 94133 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3120003610 con 0x7f313808d4d0 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872173904 0 0) 0x7f313808a690 con 0x7f313808ddb0 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 10 monclient(hunting): my global_id is 25059 2026-02-21T01:33:21.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3138088ae0 con 0x7f313808ddb0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2107251965 0 0) 0x7f3120003610 con 0x7f313808d4d0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 >> v1:10.20.193.46:6789/0 conn(0x7f313808d8d0 legacy=0x7f313819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.935+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 >> v1:10.20.193.43:6789/0 conn(0x7f313808ddb0 legacy=0x7f313808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 1 monclient: found mon.noname-b 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31381a3ef0 con 0x7f313808d4d0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: _finish_auth 0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f312c002df0 con 0x7f313808d4d0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 5 monclient: authenticate success, global_id 94133 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: dump: 2026-02-21T01:33:21.950 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f312c003030 con 0x7f313808d4d0 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 1 -- 10.20.193.43:0/695347 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f312c003470 con 0x7f313808d4d0 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f3127fff640 10 monclient: dump: 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.951 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 4 set_mon_vals no callback set 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 10 monclient: shutdown 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 -- 10.20.193.43:0/695347 >> v1:10.20.193.43:6790/0 conn(0x7f313808d4d0 legacy=0x7f313817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 -- 10.20.193.43:0/695347 shutdown_connections 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 -- 10.20.193.43:0/695347 >> 10.20.193.43:0/695347 conn(0x7f313808f480 msgr2=0x7f313808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 -- 10.20.193.43:0/695347 shutdown_connections 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 -- 10.20.193.43:0/695347 wait complete. 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 10 monclient: build_initial_monmap 2026-02-21T01:33:21.952 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 10 monclient: monmap: 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 librados: starting msgr at 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 librados: starting objecter 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 Processor -- start 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 -- start start 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 librados: setting wanted keys 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 1 librados: calling monclient init 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.936+0000 7f313f4d0640 10 monclient: init 2026-02-21T01:33:21.953 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient(hunting): picked mon.noname-b con 0x7f313808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient(hunting): picked mon.noname-a con 0x7f313808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient(hunting): picked mon.noname-c con 0x7f313808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3138125e80 con 0x7f313808d8d0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3138123770 con 0x7f313808d4d0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31381258b0 con 0x7f313808ddb0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient(hunting): authenticate will time out at 933.643230s 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313ca44640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f313808d8d0 0x7f3138123060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53854/0 (socket says 10.20.193.43:53854) 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313ca44640 1 -- 10.20.193.43:0/677526460 learned_addr learned my addr 10.20.193.43:0/677526460 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 client.?.objecter ms_handle_connect 0x7f313808d8d0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 client.?.objecter ms_handle_connect 0x7f313808ddb0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675473850 0 0) 0x7f31381a3ef0 con 0x7f313808d8d0 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.954 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): my global_id is 25062 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3108003610 con 0x7f313808d8d0 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881786085 0 0) 0x7f31381258b0 con 0x7f313808ddb0 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): my global_id is 94136 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31381a3ef0 con 0x7f313808ddb0 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2043530666 0 0) 0x7f3108003610 con 0x7f313808d8d0 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31381258b0 con 0x7f313808d8d0 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f312c003380 con 0x7f313808d8d0 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.955 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 774742593 0 0) 0x7f31381a3ef0 con 0x7f313808ddb0 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3108003610 con 0x7f313808ddb0 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f31340032d0 con 0x7f313808ddb0 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.956 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 545173249 0 0) 0x7f31381258b0 con 0x7f313808d8d0 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.43:6790/0 conn(0x7f313808ddb0 legacy=0x7f313819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.46:6789/0 conn(0x7f313808d4d0 legacy=0x7f3138122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 monclient: found mon.a 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31381243c0 con 0x7f313808d8d0 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: _finish_auth 0 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 5 monclient: authenticate success, global_id 25062 2026-02-21T01:33:21.957 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient: _renew_subs 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3138126720 con 0x7f313808d8d0 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 client.25062.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient: _renew_subs 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f31381252f0 con 0x7f313808d8d0 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f312c004c20 con 0x7f313808d8d0 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 1 librados: init done 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f312c004fb0 con 0x7f313808d8d0 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f3125ffb640 10 monclient: dump: 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.958 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f31277fe640 4 set_mon_vals no callback set 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.937+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f313808edb0 con 0x7f31381a10d0 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 client.25062.objecter ms_handle_connect 0x7f31381a10d0 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 client.25062.objecter resend_mon_ops 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786273941 0 0) 0x7f313808edb0 con 0x7f31381a10d0 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient(hunting): my global_id is 25065 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31381258b0 con 0x7f31381a10d0 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f312c0051d0 con 0x7f313808d8d0 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(292..292 src has 1..292) ==== 5171+0+0 (unknown 1831276532 0 0) 0x7f312c04e330 con 0x7f313808d8d0 2026-02-21T01:33:21.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 client.25062.objecter ms_dispatch2 0x7f3138000b90 osd_map(292..292 src has 1..292) 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 3 client.25062.objecter handle_osd_map got epochs [292,292] > 0 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 3 client.25062.objecter handle_osd_map decoding full epoch 292 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 20 client.25062.objecter dump_active .. 0 homeless 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2006258204 0 0) 0x7f31381258b0 con 0x7f31381a10d0 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f313808edb0 con 0x7f31381a10d0 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3128002e90 con 0x7f31381a10d0 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient: dump: 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.960 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f313da46640 10 monclient: get_auth_request con 0x7f310803e9e0 auth_method 0 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 885894955 0 0) 0x7f313808edb0 con 0x7f31381a10d0 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31380008d0 con 0x7f31381a10d0 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 client.25062.objecter ms_handle_connect 0x7f310803e9e0 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3128002e60 con 0x7f31381a10d0 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.43:6789/0 conn(0x7f31381a10d0 legacy=0x7f31381a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.938+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.43:6789/0 conn(0x7f31381a10d0 legacy=0x7f31381a29b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3138126fd0 con 0x7f313804ca30 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 client.25062.objecter ms_handle_connect 0x7f313804ca30 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 client.25062.objecter resend_mon_ops 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835226125 0 0) 0x7f3138126fd0 con 0x7f313804ca30 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient(hunting): my global_id is 25068 2026-02-21T01:33:21.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f313808edb0 con 0x7f313804ca30 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1566980593 0 0) 0x7f313808edb0 con 0x7f313804ca30 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3138126fd0 con 0x7f313804ca30 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f31280048d0 con 0x7f313804ca30 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient: dump: 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:21.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2682725577 0 0) 0x7f3138126fd0 con 0x7f313804ca30 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3138114380 con 0x7f313804ca30 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4318 (unknown 0 0 1141870046) 0x7f3128006b90 con 0x7f313804ca30 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.43:6789/0 conn(0x7f313804ca30 legacy=0x7f3138111c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f3125ffb640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.43:6789/0 conn(0x7f313804ca30 legacy=0x7f3138111c50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:21.963 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 26, 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 337573, 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:21.964 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:21.965 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:21.966 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:21.967 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:21.968 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:21.969 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:21.970 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:21.971 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:33:21.972 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:21.972 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:21.972 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:21.972 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:21.972 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:21.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 10 librados: watch_flush enter 2026-02-21T01:33:21.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 10 librados: watch_flush exit 2026-02-21T01:33:21.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 20 client.25062.objecter shutdown clearing up homeless session... 2026-02-21T01:33:21.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 10 client.25062.objecter successfully canceled tick 2026-02-21T01:33:21.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.46:6812/860801619 conn(0x7f310803e9e0 legacy=0x7f310805ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 10 monclient: shutdown 2026-02-21T01:33:21.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 >> v1:10.20.193.43:6789/0 conn(0x7f313808d8d0 legacy=0x7f3138123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313da46640 1 -- 10.20.193.43:0/677526460 reap_dead start 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313da46640 1 -- 10.20.193.43:0/677526460 reap_dead start 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 shutdown_connections 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 >> 10.20.193.43:0/677526460 conn(0x7f313808f480 msgr2=0x7f313805b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 shutdown_connections 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 -- 10.20.193.43:0/677526460 wait complete. 2026-02-21T01:33:21.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:21.942+0000 7f313f4d0640 1 librados: shutdown 2026-02-21T01:33:21.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:33:21.974 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:33:21.974 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:33:22.042 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.041+0000 7fd6726e8640 10 monclient: get_monmap_and_config 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.041+0000 7fd6726e8640 10 monclient: build_initial_monmap 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.041+0000 7fd6726e8640 10 monclient: monmap: 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:22.042505+0000 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:22.042505+0000 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:22.043 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.041+0000 7fd6726e8640 1 Processor -- start 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.041+0000 7fd6726e8640 1 -- start start 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.041+0000 7fd6726e8640 10 monclient: init 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient(hunting): picked mon.noname-c con 0x7fd66c058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient(hunting): picked mon.noname-a con 0x7fd66c057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient(hunting): picked mon.noname-b con 0x7fd66c181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c056c50 con 0x7fd66c057630 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c08eda0 con 0x7fd66c058260 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c08f5c0 con 0x7fd66c181e80 2026-02-21T01:33:22.053 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient(hunting): authenticate will time out at 933.748158s 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66b7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd66c057630 0x7fd66c08e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53888/0 (socket says 10.20.193.43:53888) 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66b7fe640 1 -- 10.20.193.43:0/2879265912 learned_addr learned my addr 10.20.193.43:0/2879265912 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd670c5e640 1 --1- 10.20.193.43:0/2879265912 >> v1:10.20.193.43:6790/0 conn(0x7fd66c181e80 0x7fd66c1a2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:48562/0 (socket says 10.20.193.43:48562) 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385408642 0 0) 0x7fd66c08f5c0 con 0x7fd66c181e80 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): my global_id is 94139 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd650003610 con 0x7fd66c181e80 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089026702 0 0) 0x7fd66c056c50 con 0x7fd66c057630 2026-02-21T01:33:22.054 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient(hunting): my global_id is 25071 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c08f5c0 con 0x7fd66c057630 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3384429419 0 0) 0x7fd650003610 con 0x7fd66c181e80 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 >> v1:10.20.193.46:6789/0 conn(0x7fd66c058260 legacy=0x7fd66c08df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 >> v1:10.20.193.43:6789/0 conn(0x7fd66c057630 legacy=0x7fd66c08e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: _finish_hunting 0 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 monclient: found mon.noname-b 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c0563b0 con 0x7fd66c181e80 2026-02-21T01:33:22.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: _finish_auth 0 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: _check_auth_tickets 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 5 monclient: authenticate success, global_id 94139 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd660003170 con 0x7fd66c181e80 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: dump: 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.056 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6600033c0 con 0x7fd66c181e80 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 1 -- 10.20.193.43:0/2879265912 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd660003800 con 0x7fd66c181e80 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 4 set_mon_vals no callback set 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:22.057 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd66affd640 10 monclient: dump: 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 10 monclient: shutdown 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:22.058 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 1 -- 10.20.193.43:0/2879265912 >> v1:10.20.193.43:6790/0 conn(0x7fd66c181e80 legacy=0x7fd66c1a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 1 -- 10.20.193.43:0/2879265912 shutdown_connections 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 1 -- 10.20.193.43:0/2879265912 >> 10.20.193.43:0/2879265912 conn(0x7fd66c090360 msgr2=0x7fd66c090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.042+0000 7fd6726e8640 1 -- 10.20.193.43:0/2879265912 shutdown_connections 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 -- 10.20.193.43:0/2879265912 wait complete. 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient: build_initial_monmap 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient: monmap: 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.059 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 librados: starting msgr at 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 librados: starting objecter 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 Processor -- start 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 -- start start 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 librados: setting wanted keys 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 librados: calling monclient init 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient: init 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:22.060 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient(hunting): picked mon.noname-a con 0x7fd66c057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient(hunting): picked mon.noname-b con 0x7fd66c058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient(hunting): picked mon.noname-c con 0x7fd66c181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c149830 con 0x7fd66c057630 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c08a870 con 0x7fd66c058260 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c12fc10 con 0x7fd66c181e80 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd6726e8640 10 monclient(hunting): authenticate will time out at 933.749857s 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd66bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fd66c057630 0x7fd66c149120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53900/0 (socket says 10.20.193.43:53900) 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd66bfff640 1 -- 10.20.193.43:0/1132206397 learned_addr learned my addr 10.20.193.43:0/1132206397 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 client.?.objecter ms_handle_connect 0x7fd66c057630 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 client.?.objecter ms_handle_connect 0x7fd66c181e80 2026-02-21T01:33:22.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569773941 0 0) 0x7fd66c149830 con 0x7fd66c057630 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.043+0000 7fd668ff9640 10 monclient(hunting): my global_id is 25074 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd63c003610 con 0x7fd66c057630 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119390850 0 0) 0x7fd66c12fc10 con 0x7fd66c181e80 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): my global_id is 94142 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c149830 con 0x7fd66c181e80 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 client.?.objecter ms_handle_connect 0x7fd66c058260 2026-02-21T01:33:22.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1857700733 0 0) 0x7fd63c003610 con 0x7fd66c057630 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c12fc10 con 0x7fd66c057630 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd658003190 con 0x7fd66c057630 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): dump: 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.063 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3993411994 0 0) 0x7fd66c149830 con 0x7fd66c181e80 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd63c003610 con 0x7fd66c181e80 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd660003570 con 0x7fd66c181e80 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): dump: 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.064 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4194456268 0 0) 0x7fd66c12fc10 con 0x7fd66c057630 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.43:6790/0 conn(0x7fd66c181e80 legacy=0x7fd66c171bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.46:6789/0 conn(0x7fd66c058260 legacy=0x7fd66c1704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 monclient: found mon.a 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:22.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c12e720 con 0x7fd66c057630 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: _finish_auth 0 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 5 monclient: authenticate success, global_id 25074 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 10 monclient: _renew_subs 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c130a80 con 0x7fd66c057630 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 10 client.25074.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 10 monclient: _renew_subs 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd66c14c2f0 con 0x7fd66c057630 2026-02-21T01:33:22.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 1 librados: init done 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6580039b0 con 0x7fd66c057630 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd658003d80 con 0x7fd66c057630 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd66a7fc640 4 set_mon_vals no callback set 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient: dump: 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.067 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd66c12f650 con 0x7fd66c12f280 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 client.25074.objecter ms_handle_connect 0x7fd66c12f280 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 client.25074.objecter resend_mon_ops 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219368449 0 0) 0x7fd66c12f650 con 0x7fd66c12f280 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 10 monclient(hunting): my global_id is 94145 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c12fc10 con 0x7fd66c12f280 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.044+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fd658003f20 con 0x7fd66c057630 2026-02-21T01:33:22.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(292..292 src has 1..292) ==== 5171+0+0 (unknown 1831276532 0 0) 0x7fd65804e470 con 0x7fd66c057630 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 10 client.25074.objecter ms_dispatch2 0x7fd66c000b90 osd_map(292..292 src has 1..292) 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 3 client.25074.objecter handle_osd_map got epochs [292,292] > 0 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 3 client.25074.objecter handle_osd_map decoding full epoch 292 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 20 client.25074.objecter dump_active .. 0 homeless 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 723761842 0 0) 0x7fd66c12fc10 con 0x7fd66c12f280 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c12f650 con 0x7fd66c12f280 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd65c002e90 con 0x7fd66c12f280 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 10 monclient: dump: 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.069 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd670c5e640 10 monclient: get_auth_request con 0x7fd63c03ea80 auth_method 0 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 123413858 0 0) 0x7fd66c12f650 con 0x7fd66c12f280 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd66c0008d0 con 0x7fd66c12f280 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 10 client.25074.objecter ms_handle_connect 0x7fd63c03ea80 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd65c0059c0 con 0x7fd66c12f280 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.43:6790/0 conn(0x7fd66c12f280 legacy=0x7fd66c087390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.045+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.43:6790/0 conn(0x7fd66c12f280 legacy=0x7fd66c087390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd6726e8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd66c092830 con 0x7fd66c087aa0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 client.25074.objecter ms_handle_connect 0x7fd66c087aa0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 client.25074.objecter resend_mon_ops 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658675848 0 0) 0x7fd66c092830 con 0x7fd66c087aa0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 monclient(hunting): my global_id is 94148 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c12f650 con 0x7fd66c087aa0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4078083166 0 0) 0x7fd66c12f650 con 0x7fd66c087aa0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c092830 con 0x7fd66c087aa0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fd65c0034f0 con 0x7fd66c087aa0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.048+0000 7fd668ff9640 10 monclient: dump: 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.072 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3979852639 0 0) 0x7fd66c092830 con 0x7fd66c087aa0 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd66c12e1a0 con 0x7fd66c087aa0 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4147 (unknown 0 0 1628698224) 0x7fd65c0048d0 con 0x7fd66c087aa0 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd668ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd668ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:22.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.43:6790/0 conn(0x7fd66c087aa0 legacy=0x7fd66c174320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd668ff9640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.43:6790/0 conn(0x7fd66c087aa0 legacy=0x7fd66c174320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:22.074 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:22.074 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:22.074 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 26, 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 2154, 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:22.075 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:22.076 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:22.077 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:22.078 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.079 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.080 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.081 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.082 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:22.083 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 10 librados: watch_flush enter 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 10 librados: watch_flush exit 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 20 client.25074.objecter shutdown clearing up homeless session... 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 10 client.25074.objecter successfully canceled tick 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.46:6812/860801619 conn(0x7fd63c03ea80 legacy=0x7fd63c05ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 10 monclient: shutdown 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 >> v1:10.20.193.43:6789/0 conn(0x7fd66c057630 legacy=0x7fd66c149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd670c5e640 1 -- 10.20.193.43:0/1132206397 reap_dead start 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd670c5e640 1 -- 10.20.193.43:0/1132206397 reap_dead start 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 shutdown_connections 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 >> 10.20.193.43:0/1132206397 conn(0x7fd66c090360 msgr2=0x7fd66c08aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 shutdown_connections 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 1 -- 10.20.193.43:0/1132206397 wait complete. 2026-02-21T01:33:22.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.049+0000 7fd6726e8640 1 librados: shutdown 2026-02-21T01:33:22.086 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:33:22.086 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:33:22.086 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient: get_monmap_and_config 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient: build_initial_monmap 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient: monmap: 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:22.154411+0000 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:22.154411+0000 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:22.154 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 1 Processor -- start 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 1 -- start start 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient: init 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient(hunting): picked mon.noname-c con 0x7f69a008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient(hunting): picked mon.noname-b con 0x7f69a008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient(hunting): picked mon.noname-a con 0x7f69a008d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a008a690 con 0x7f69a008d8d0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a008b910 con 0x7f69a008ddb0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a0088ae0 con 0x7f69a008d4d0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f69a5c32640 10 monclient(hunting): authenticate will time out at 933.859831s 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f699effd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f69a008d4d0 0x7f69a017e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:48592/0 (socket says 10.20.193.43:48592) 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.153+0000 7f699effd640 1 -- 10.20.193.43:0/469928196 learned_addr learned my addr 10.20.193.43:0/469928196 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889189984 0 0) 0x7f69a008a690 con 0x7f69a008d8d0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): my global_id is 25077 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6984003610 con 0x7f69a008d8d0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328652335 0 0) 0x7f69a0088ae0 con 0x7f69a008d4d0 2026-02-21T01:33:22.158 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient(hunting): my global_id is 94151 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a008a690 con 0x7f69a008d4d0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1291682642 0 0) 0x7f6984003610 con 0x7f69a008d8d0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 >> v1:10.20.193.43:6790/0 conn(0x7f69a008d4d0 legacy=0x7f69a017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 >> v1:10.20.193.46:6789/0 conn(0x7f69a008ddb0 legacy=0x7f69a008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 monclient: found mon.noname-a 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a01a3ef0 con 0x7f69a008d8d0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: _finish_auth 0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f69940030a0 con 0x7f69a008d8d0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 5 monclient: authenticate success, global_id 25077 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: dump: 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.159 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6994003360 con 0x7f69a008d8d0 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 1 -- 10.20.193.43:0/469928196 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f69940037a0 con 0x7f69a008d8d0 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 4 set_mon_vals no callback set 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f699e7fc640 10 monclient: dump: 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 10 monclient: shutdown 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 1 -- 10.20.193.43:0/469928196 >> v1:10.20.193.43:6789/0 conn(0x7f69a008d8d0 legacy=0x7f69a019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 1 -- 10.20.193.43:0/469928196 shutdown_connections 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 1 -- 10.20.193.43:0/469928196 >> 10.20.193.43:0/469928196 conn(0x7f69a008f480 msgr2=0x7f69a008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 1 -- 10.20.193.43:0/469928196 shutdown_connections 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 1 -- 10.20.193.43:0/469928196 wait complete. 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 10 monclient: build_initial_monmap 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.154+0000 7f69a5c32640 10 monclient: monmap: 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:22.160 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 librados: starting msgr at 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 librados: starting objecter 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 Processor -- start 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 -- start start 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 librados: setting wanted keys 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 librados: calling monclient init 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient: init 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient(hunting): picked mon.noname-a con 0x7f69a008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient(hunting): picked mon.noname-c con 0x7f69a008d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient(hunting): picked mon.noname-b con 0x7f69a008ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a0129d20 con 0x7f69a008d4d0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a012d180 con 0x7f69a008ddb0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a0057130 con 0x7f69a008d8d0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient(hunting): authenticate will time out at 933.861443s 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f699f7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f69a008d4d0 0x7f69a012c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53912/0 (socket says 10.20.193.43:53912) 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f699f7fe640 1 -- 10.20.193.43:0/3035422604 learned_addr learned my addr 10.20.193.43:0/3035422604 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 client.?.objecter ms_handle_connect 0x7f69a008d8d0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 client.?.objecter ms_handle_connect 0x7f69a008d4d0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957841695 0 0) 0x7f69a0057130 con 0x7f69a008d8d0 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.161 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): my global_id is 94154 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6970003610 con 0x7f69a008d8d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333808084 0 0) 0x7f69a0129d20 con 0x7f69a008d4d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): my global_id is 25080 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a0057130 con 0x7f69a008d4d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 620448731 0 0) 0x7f6970003610 con 0x7f69a008d8d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69a0129d20 con 0x7f69a008d8d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6990003140 con 0x7f69a008d8d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): dump: 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 450437139 0 0) 0x7f69a0057130 con 0x7f69a008d4d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6970003610 con 0x7f69a008d4d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f698c003190 con 0x7f69a008d4d0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:22.162 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient(hunting): dump: 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3075564070 0 0) 0x7f69a0129d20 con 0x7f69a008d8d0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.46:6789/0 conn(0x7f69a008ddb0 legacy=0x7f69a019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.43:6789/0 conn(0x7f69a008d4d0 legacy=0x7f69a012c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 monclient: found mon.c 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a005e1b0 con 0x7f69a008d8d0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: _finish_auth 0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 5 monclient: authenticate success, global_id 94154 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient: _renew_subs 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f69a010cb10 con 0x7f69a008d8d0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 client.94154.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient: _renew_subs 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69900048d0 con 0x7f69a008d8d0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f69a010b4f0 con 0x7f69a008d8d0 2026-02-21T01:33:22.163 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f69a5c32640 1 librados: init done 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6990004c20 con 0x7f69a008d8d0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f699dffb640 4 set_mon_vals no callback set 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.155+0000 7f697bfff640 10 monclient: dump: 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f69a5c32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f69a008edb0 con 0x7f69a01a10d0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f69900115a0 con 0x7f69a008d8d0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(292..292 src has 1..292) ==== 5171+0+0 (unknown 1831276532 0 0) 0x7f699004e2b0 con 0x7f69a008d8d0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 10 client.94154.objecter ms_dispatch2 0x7f69a0000b90 osd_map(292..292 src has 1..292) 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 3 client.94154.objecter handle_osd_map got epochs [292,292] > 0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 3 client.94154.objecter handle_osd_map decoding full epoch 292 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 20 client.94154.objecter dump_active .. 0 homeless 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 10 client.94154.objecter ms_handle_connect 0x7f69a01a10d0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f697bfff640 10 client.94154.objecter resend_mon_ops 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.156+0000 7f699ffff640 10 monclient: get_auth_request con 0x7f697003e840 auth_method 0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004696045 0 0) 0x7f69a008edb0 con 0x7f69a01a10d0 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient(hunting): my global_id is 84301 2026-02-21T01:33:22.164 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a0129d20 con 0x7f69a01a10d0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3084922956 0 0) 0x7f69a0129d20 con 0x7f69a01a10d0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69a008edb0 con 0x7f69a01a10d0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f698c003c50 con 0x7f69a01a10d0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient: dump: 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 client.94154.objecter ms_handle_connect 0x7f697003e840 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1571297606 0 0) 0x7f69a008edb0 con 0x7f69a01a10d0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69a010c380 con 0x7f69a01a10d0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f698c0058b0 con 0x7f69a01a10d0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.46:6789/0 conn(0x7f69a01a10d0 legacy=0x7f69a00596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.157+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.46:6789/0 conn(0x7f69a01a10d0 legacy=0x7f69a00596e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.160+0000 7f69a5c32640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.160+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f69a004d140 con 0x7f69a01292c0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 client.94154.objecter ms_handle_connect 0x7f69a01292c0 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 client.94154.objecter resend_mon_ops 2026-02-21T01:33:22.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976647677 0 0) 0x7f69a004d140 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient(hunting): my global_id is 84304 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a008edb0 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1171781197 0 0) 0x7f69a008edb0 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69a004d140 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f698c004250 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient: dump: 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 432184845 0 0) 0x7f69a004d140 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69a01296c0 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4483 (unknown 0 0 357615318) 0x7f698c004140 con 0x7f69a01292c0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.46:6789/0 conn(0x7f69a01292c0 legacy=0x7f69a004ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.161+0000 7f697bfff640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.46:6789/0 conn(0x7f69a01292c0 legacy=0x7f69a004ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:22.167 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 26, 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 109180, 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 2, 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:22.168 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:22.169 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.170 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:22.171 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.172 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:22.173 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 10 librados: watch_flush enter 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 10 librados: watch_flush exit 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 20 client.94154.objecter shutdown clearing up homeless session... 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 10 client.94154.objecter successfully canceled tick 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.46:6812/860801619 conn(0x7f697003e840 legacy=0x7f697005ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 10 monclient: shutdown 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 >> v1:10.20.193.43:6790/0 conn(0x7f69a008d8d0 legacy=0x7f69a012ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f699ffff640 1 -- 10.20.193.43:0/3035422604 reap_dead start 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f699ffff640 1 -- 10.20.193.43:0/3035422604 reap_dead start 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 shutdown_connections 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 >> 10.20.193.43:0/3035422604 conn(0x7f69a008f480 msgr2=0x7f69a011f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 shutdown_connections 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 1 -- 10.20.193.43:0/3035422604 wait complete. 2026-02-21T01:33:22.174 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.162+0000 7f69a5c32640 1 librados: shutdown 2026-02-21T01:33:22.174 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:33:22.174 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-21T01:33:22.174 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-21T01:33:22.174 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-21T01:33:22.175 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-21T01:33:22.175 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-21T01:33:22.175 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:33:22.183 INFO:tasks.ceph.mon.c:Stopped 2026-02-21T01:33:22.183 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-21T01:33:22.183 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.289+0000 7f15c185b640 10 monclient: get_monmap_and_config 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.289+0000 7f15c185b640 10 monclient: build_initial_monmap 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.289+0000 7f15c185b640 10 monclient: monmap: 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:22.290720+0000 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:22.290720+0000 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:22.290 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.291 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:22.291 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:22.291 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:22.291 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.289+0000 7f15c185b640 1 Processor -- start 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.289+0000 7f15c185b640 1 -- start start 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.289+0000 7f15c185b640 10 monclient: init 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient(hunting): picked mon.noname-a con 0x7f15bc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient(hunting): picked mon.noname-c con 0x7f15bc08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient(hunting): picked mon.noname-b con 0x7f15bc08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc08a690 con 0x7f15bc08ddb0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc08b910 con 0x7f15bc08d4d0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc088ae0 con 0x7f15bc08d8d0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient(hunting): authenticate will time out at 933.996152s 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15bb7fe640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f15bc08d8d0 legacy=0x7f15bc19f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15baffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f15bc08ddb0 0x7f15bc08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53914/0 (socket says 10.20.193.43:53914) 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15baffd640 1 -- 10.20.193.43:0/1711381536 learned_addr learned my addr 10.20.193.43:0/1711381536 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1118040907 0 0) 0x7f15bc08a690 con 0x7f15bc08ddb0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient(hunting): my global_id is 25083 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a8003610 con 0x7f15bc08ddb0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4252560181 0 0) 0x7f15a8003610 con 0x7f15bc08ddb0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 >> v1:10.20.193.43:6790/0 conn(0x7f15bc08d8d0 legacy=0x7f15bc19f7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 >> v1:10.20.193.46:6789/0 conn(0x7f15bc08d4d0 legacy=0x7f15bc17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 monclient: found mon.noname-a 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc1a3ef0 con 0x7f15bc08ddb0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: _finish_auth 0 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:33:22.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15b0002df0 con 0x7f15bc08ddb0 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 5 monclient: authenticate success, global_id 25083 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: dump: 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15b00030f0 con 0x7f15bc08ddb0 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 1 -- 10.20.193.43:0/1711381536 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15b0003530 con 0x7f15bc08ddb0 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15c185b640 4 set_mon_vals no callback set 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.290+0000 7f15b9ffb640 10 monclient: dump: 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient: shutdown 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- 10.20.193.43:0/1711381536 >> v1:10.20.193.43:6789/0 conn(0x7f15bc08ddb0 legacy=0x7f15bc08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- 10.20.193.43:0/1711381536 shutdown_connections 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- 10.20.193.43:0/1711381536 >> 10.20.193.43:0/1711381536 conn(0x7f15bc08f480 msgr2=0x7f15bc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- 10.20.193.43:0/1711381536 shutdown_connections 2026-02-21T01:33:22.293 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- 10.20.193.43:0/1711381536 wait complete. 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient: build_initial_monmap 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient: monmap: 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 librados: starting msgr at 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 librados: starting objecter 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 Processor -- start 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- start start 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 librados: setting wanted keys 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 librados: calling monclient init 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient: init 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient(hunting): picked mon.noname-b con 0x7f15bc08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient(hunting): picked mon.noname-a con 0x7f15bc08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient(hunting): picked mon.noname-c con 0x7f15bc08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc10ce10 con 0x7f15bc08d8d0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc0575a0 con 0x7f15bc08d4d0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc057050 con 0x7f15bc08ddb0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15c185b640 10 monclient(hunting): authenticate will time out at 933.997863s 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15bb7fe640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f15bc08ddb0 legacy=0x7f15bc19c010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15ba7fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f15bc08d8d0 0x7f15bc19a8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53922/0 (socket says 10.20.193.43:53922) 2026-02-21T01:33:22.295 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f15ba7fc640 1 -- 10.20.193.43:0/1280442099 learned_addr learned my addr 10.20.193.43:0/1280442099 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f1593fff640 10 client.?.objecter ms_handle_connect 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.291+0000 7f1593fff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924390946 0 0) 0x7f15bc10ce10 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): my global_id is 25086 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158c003610 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 722387947 0 0) 0x7f158c003610 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15bc10ce10 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15a4003150 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): dump: 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4107940964 0 0) 0x7f15bc10ce10 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 >> v1:10.20.193.43:6790/0 conn(0x7f15bc08ddb0 legacy=0x7f15bc19c010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 >> v1:10.20.193.46:6789/0 conn(0x7f15bc08d4d0 legacy=0x7f15bc12ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 monclient: found mon.a 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc05e1b0 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: _finish_auth 0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 5 monclient: authenticate success, global_id 25086 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 monclient: _renew_subs 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc10c850 con 0x7f15bc08d8d0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 client.25086.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 monclient: _renew_subs 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.296 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f15bc10b9c0 con 0x7f15bc08d8d0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 1 librados: init done 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15a40039f0 con 0x7f15bc08d8d0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f15a4003dc0 con 0x7f15bc08d8d0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 10 monclient: dump: 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15b97fa640 4 set_mon_vals no callback set 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f15a4003f60 con 0x7f15bc08d8d0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.292+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc089960 con 0x7f15bc08d8d0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.293+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(292..292 src has 1..292) ==== 5171+0+0 (unknown 1831276532 0 0) 0x7f15a404e470 con 0x7f15bc08d8d0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.293+0000 7f1593fff640 10 client.25086.objecter ms_dispatch2 0x7f15bc000b90 osd_map(292..292 src has 1..292) 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.293+0000 7f1593fff640 3 client.25086.objecter handle_osd_map got epochs [292,292] > 0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.293+0000 7f1593fff640 3 client.25086.objecter handle_osd_map decoding full epoch 292 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.293+0000 7f1593fff640 20 client.25086.objecter dump_active .. 0 homeless 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.293+0000 7f15baffd640 10 monclient: get_auth_request con 0x7f158c03e7e0 auth_method 0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.293+0000 7f1593fff640 10 client.25086.objecter ms_handle_connect 0x7f158c03e7e0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.295+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f15bc089960 con 0x7f15bc08d8d0 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.295+0000 7f1593fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:22.297 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.295+0000 7f1593fff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.444+0000 7f15c185b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.444+0000 7f15c185b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.444+0000 7f15c185b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.444+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f15bc054ff0 con 0x7f15bc08d8d0 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.445+0000 7f1593fff640 1 -- 10.20.193.43:0/1280442099 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 2148598659) 0x7f15a4017830 con 0x7f15bc08d8d0 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.445+0000 7f1593fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.445+0000 7f1593fff640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:22.446 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 10 librados: watch_flush enter 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 10 librados: watch_flush exit 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 20 client.25086.objecter shutdown clearing up homeless session... 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 10 client.25086.objecter successfully canceled tick 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 >> v1:10.20.193.46:6812/860801619 conn(0x7f158c03e7e0 legacy=0x7f158c05ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 10 monclient: shutdown 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 >> v1:10.20.193.43:6789/0 conn(0x7f15bc08d8d0 legacy=0x7f15bc19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 shutdown_connections 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 >> 10.20.193.43:0/1280442099 conn(0x7f15bc08f480 msgr2=0x7f15bc11f230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 shutdown_connections 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 1 -- 10.20.193.43:0/1280442099 wait complete. 2026-02-21T01:33:22.447 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:22.446+0000 7f15c185b640 1 librados: shutdown 2026-02-21T01:33:25.455 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.525+0000 7f6fb3a09640 10 monclient: get_monmap_and_config 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.525+0000 7f6fb3a09640 10 monclient: build_initial_monmap 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.525+0000 7f6fb3a09640 10 monclient: monmap: 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:25.526638+0000 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:25.526638+0000 2026-02-21T01:33:25.527 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.525+0000 7f6fb3a09640 1 Processor -- start 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.525+0000 7f6fb3a09640 1 -- start start 2026-02-21T01:33:25.528 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.525+0000 7f6fb3a09640 10 monclient: init 2026-02-21T01:33:25.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:25.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:33:25.538 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient(hunting): picked mon.noname-b con 0x7f6fac05cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient(hunting): picked mon.noname-a con 0x7f6fac08a730 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient(hunting): picked mon.noname-c con 0x7f6fac13fa20 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fac05d9d0 con 0x7f6fac08a730 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fac08b590 con 0x7f6fac13fa20 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fac05b9c0 con 0x7f6fac05cef0 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient(hunting): authenticate will time out at 937.232089s 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb177e640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f6fac05cef0 legacy=0x7f6fac05d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb0f7d640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6fac08a730 0x7f6fac180300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53928/0 (socket says 10.20.193.43:53928) 2026-02-21T01:33:25.539 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb0f7d640 1 -- 10.20.193.43:0/2046129470 learned_addr learned my addr 10.20.193.43:0/2046129470 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11040182 0 0) 0x7f6fac05d9d0 con 0x7f6fac08a730 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient(hunting): my global_id is 25089 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f94003610 con 0x7f6fac08a730 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4021927636 0 0) 0x7f6f94003610 con 0x7f6fac08a730 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 >> v1:10.20.193.43:6790/0 conn(0x7f6fac05cef0 legacy=0x7f6fac05d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 >> v1:10.20.193.46:6789/0 conn(0x7f6fac13fa20 legacy=0x7f6fac1a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:25.540 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 monclient: found mon.noname-a 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fac13f210 con 0x7f6fac08a730 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: _finish_auth 0 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6fa0002df0 con 0x7f6fac08a730 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: dump: 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:25.541 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 5 monclient: authenticate success, global_id 25089 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fa00030f0 con 0x7f6fac08a730 2026-02-21T01:33:25.542 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 1 -- 10.20.193.43:0/2046129470 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6fa0003530 con 0x7f6fac08a730 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 4 set_mon_vals no callback set 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6f9bfff640 10 monclient: dump: 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:25.543 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 10 monclient: shutdown 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- 10.20.193.43:0/2046129470 >> v1:10.20.193.43:6789/0 conn(0x7f6fac08a730 legacy=0x7f6fac180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:25.544 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- 10.20.193.43:0/2046129470 shutdown_connections 2026-02-21T01:33:25.545 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- 10.20.193.43:0/2046129470 >> 10.20.193.43:0/2046129470 conn(0x7f6fac08f480 msgr2=0x7f6fac08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:25.545 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- 10.20.193.43:0/2046129470 shutdown_connections 2026-02-21T01:33:25.545 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.526+0000 7f6fb3a09640 1 -- 10.20.193.43:0/2046129470 wait complete. 2026-02-21T01:33:25.545 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient: build_initial_monmap 2026-02-21T01:33:25.545 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient: monmap: 2026-02-21T01:33:25.545 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:25.546 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:25.546 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:25.546 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:25.546 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:25.546 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:25.546 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:25.546 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:25.547 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:25.547 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:25.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 librados: starting msgr at 2026-02-21T01:33:25.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 librados: starting objecter 2026-02-21T01:33:25.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 Processor -- start 2026-02-21T01:33:25.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 -- start start 2026-02-21T01:33:25.547 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 librados: setting wanted keys 2026-02-21T01:33:25.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 librados: calling monclient init 2026-02-21T01:33:25.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient: init 2026-02-21T01:33:25.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:25.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:33:25.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient(hunting): picked mon.noname-c con 0x7f6fac05cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:25.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient(hunting): picked mon.noname-b con 0x7f6fac08a730 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:25.548 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient(hunting): picked mon.noname-a con 0x7f6fac13fa20 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:25.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fac13bae0 con 0x7f6fac13fa20 2026-02-21T01:33:25.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fac12bc80 con 0x7f6fac08a730 2026-02-21T01:33:25.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb177e640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7f6fac05cef0 legacy=0x7f6fac14f450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:25.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fac05e1b0 con 0x7f6fac05cef0 2026-02-21T01:33:25.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:25.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb3a09640 10 monclient(hunting): authenticate will time out at 937.233791s 2026-02-21T01:33:25.549 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb1f7f640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6fac13fa20 0x7f6fac191bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53938/0 (socket says 10.20.193.43:53938) 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6fb1f7f640 1 -- 10.20.193.43:0/4125084017 learned_addr learned my addr 10.20.193.43:0/4125084017 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 10 client.?.objecter ms_handle_connect 0x7f6fac13fa20 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618669359 0 0) 0x7f6fac13bae0 con 0x7f6fac13fa20 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 10 monclient(hunting): my global_id is 25092 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.527+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7c003610 con 0x7f6fac13fa20 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 client.?.objecter ms_handle_connect 0x7f6fac08a730 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:25.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1907785522 0 0) 0x7f6f7c003610 con 0x7f6fac13fa20 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fac13bae0 con 0x7f6fac13fa20 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6fa8003490 con 0x7f6fac13fa20 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:25.551 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1662873836 0 0) 0x7f6fac13bae0 con 0x7f6fac13fa20 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 >> v1:10.20.193.43:6790/0 conn(0x7f6fac05cef0 legacy=0x7f6fac14f450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 >> v1:10.20.193.46:6789/0 conn(0x7f6fac08a730 legacy=0x7f6fac1904d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:25.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 monclient: found mon.a 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fac12a1c0 con 0x7f6fac13fa20 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: _finish_auth 0 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 5 monclient: authenticate success, global_id 25092 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 monclient: _renew_subs 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fac12ad20 con 0x7f6fac13fa20 2026-02-21T01:33:25.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 client.25092.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 monclient: _renew_subs 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fac1297a0 con 0x7f6fac13fa20 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 1 librados: init done 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fa8003d70 con 0x7f6fac13fa20 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6fa8003fa0 con 0x7f6fac13fa20 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 monclient: dump: 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:25.554 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f9b7fe640 4 set_mon_vals no callback set 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:25.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fac129b30 con 0x7f6fac13fa20 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f6fa8004140 con 0x7f6fac13fa20 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(292..292 src has 1..292) ==== 5171+0+0 (unknown 1831276532 0 0) 0x7f6fa804e7f0 con 0x7f6fac13fa20 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 10 client.25092.objecter ms_dispatch2 0x7f6fac000b90 osd_map(292..292 src has 1..292) 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 3 client.25092.objecter handle_osd_map got epochs [292,292] > 0 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 3 client.25092.objecter handle_osd_map decoding full epoch 292 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.528+0000 7f6f99ffb640 20 client.25092.objecter dump_active .. 0 homeless 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.529+0000 7f6fb177e640 10 monclient: get_auth_request con 0x7f6f7c03e850 auth_method 0 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.529+0000 7f6f99ffb640 10 client.25092.objecter ms_handle_connect 0x7f6f7c03e850 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.531+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6fa8017bb0 con 0x7f6fac13fa20 2026-02-21T01:33:25.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.531+0000 7f6f99ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:25.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.531+0000 7f6f99ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:25.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.679+0000 7f6fb3a09640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:33:25.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.679+0000 7f6fb3a09640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:25.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.679+0000 7f6fb3a09640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:25.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.679+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6fac13bd00 con 0x7f6fac13fa20 2026-02-21T01:33:25.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.679+0000 7f6f99ffb640 1 -- 10.20.193.43:0/4125084017 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 3495669455) 0x7f6fa80174b0 con 0x7f6fac13fa20 2026-02-21T01:33:25.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.679+0000 7f6f99ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:25.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.679+0000 7f6f99ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:25.683 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":26,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:33:25.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 10 librados: watch_flush enter 2026-02-21T01:33:25.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 10 librados: watch_flush exit 2026-02-21T01:33:25.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 20 client.25092.objecter shutdown clearing up homeless session... 2026-02-21T01:33:25.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 10 client.25092.objecter successfully canceled tick 2026-02-21T01:33:25.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 >> v1:10.20.193.46:6812/860801619 conn(0x7f6f7c03e850 legacy=0x7f6f7c05ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:25.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 10 monclient: shutdown 2026-02-21T01:33:25.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:25.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 >> v1:10.20.193.43:6789/0 conn(0x7f6fac13fa20 legacy=0x7f6fac191bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:25.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 shutdown_connections 2026-02-21T01:33:25.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 >> 10.20.193.43:0/4125084017 conn(0x7f6fac08f480 msgr2=0x7f6fac13dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:25.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 shutdown_connections 2026-02-21T01:33:25.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 1 -- 10.20.193.43:0/4125084017 wait complete. 2026-02-21T01:33:25.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:25.680+0000 7f6fb3a09640 1 librados: shutdown 2026-02-21T01:33:28.691 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:33:28.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient: get_monmap_and_config 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient: build_initial_monmap 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient: monmap: 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:28.761597+0000 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:28.761597+0000 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:28.763 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 1 Processor -- start 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 1 -- start start 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient: init 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient(hunting): picked mon.noname-a con 0x7fabfc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient(hunting): picked mon.noname-b con 0x7fabfc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient(hunting): picked mon.noname-c con 0x7fabfc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc08a690 con 0x7fabfc08ddb0 2026-02-21T01:33:28.764 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc08b910 con 0x7fabfc08d8d0 2026-02-21T01:33:28.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc088ae0 con 0x7fabfc08d4d0 2026-02-21T01:33:28.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:28.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.760+0000 7fac00e08640 10 monclient(hunting): authenticate will time out at 940.467007s 2026-02-21T01:33:28.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.761+0000 7fabf9d74640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabfc17e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:28.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.761+0000 7fabfa575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fabfc08ddb0 0x7fabfc08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:53948/0 (socket says 10.20.193.43:53948) 2026-02-21T01:33:28.765 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.761+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 learned_addr learned my addr 10.20.193.43:0/1910589538 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:28.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:28.962+0000 7fabf9d74640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabfc17e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:29.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:29.363+0000 7fabf9d74640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabfc17e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:30.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:30.164+0000 7fabf9d74640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabfc17e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.761+0000 7fabe3fff640 10 monclient(hunting): tick 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 1 monclient(hunting): continuing hunt 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabfc17e070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.46:6789/0 conn(0x7fabfc08d8d0 legacy=0x7fabfc19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6789/0 conn(0x7fabfc08ddb0 legacy=0x7fabfc08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 10 monclient(hunting): picked mon.noname-b con 0x7fabfc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 10 monclient(hunting): picked mon.noname-a con 0x7fabfc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:31.762 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 10 monclient(hunting): picked mon.noname-c con 0x7fabfc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:31.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc1a3ef0 con 0x7fabfc08ddb0 2026-02-21T01:33:31.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc088ae0 con 0x7fabfc08d8d0 2026-02-21T01:33:31.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd8069fb0 con 0x7fabfc08d4d0 2026-02-21T01:33:31.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.762+0000 7fabe3fff640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:31.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:31.963+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:32.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:32.364+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:33.165 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:33.165+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient(hunting): tick 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient(hunting): _check_auth_tickets 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 1 monclient(hunting): continuing hunt 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.46:6789/0 conn(0x7fabfc08d8d0 legacy=0x7fabd8066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6789/0 conn(0x7fabfc08ddb0 legacy=0x7fabd8044f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient(hunting): picked mon.noname-b con 0x7fabfc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient(hunting): picked mon.noname-c con 0x7fabfc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient(hunting): picked mon.noname-a con 0x7fabfc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd806b250 con 0x7fabfc08ddb0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd8069fb0 con 0x7fabfc08d8d0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd80667d0 con 0x7fabfc08d4d0 2026-02-21T01:33:34.763 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.762+0000 7fabe3fff640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:34.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:34.963+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:35.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:35.364+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:36.166 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.166+0000 7fabfa575640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:36.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666367803 0 0) 0x7fabd8069fb0 con 0x7fabfc08d8d0 2026-02-21T01:33:36.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient(hunting): my global_id is 84310 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabe8003610 con 0x7fabfc08d8d0 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1811442670 0 0) 0x7fabe8003610 con 0x7fabfc08d8d0 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabd80237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.43:6789/0 conn(0x7fabfc08ddb0 legacy=0x7fabd806a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: _finish_hunting 0 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 monclient: found mon.noname-c 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd80669f0 con 0x7fabfc08d8d0 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: _finish_auth 0 2026-02-21T01:33:36.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: _check_auth_tickets 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fac00e08640 5 monclient: authenticate success, global_id 84310 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fac00e08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fabe4004200 con 0x7fabfc08d8d0 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: dump: 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.470 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fac00e08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fabe4004440 con 0x7fabfc08d8d0 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 1 -- 10.20.193.43:0/1910589538 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fabe4004840 con 0x7fabfc08d8d0 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:36.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fabf9573640 10 monclient: dump: 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fac00e08640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.460+0000 7fac00e08640 4 set_mon_vals no callback set 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.461+0000 7fac00e08640 10 monclient: shutdown 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.461+0000 7fac00e08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.461+0000 7fac00e08640 1 -- 10.20.193.43:0/1910589538 >> v1:10.20.193.46:6789/0 conn(0x7fabfc08d8d0 legacy=0x7fabd806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.461+0000 7fac00e08640 1 -- 10.20.193.43:0/1910589538 shutdown_connections 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.461+0000 7fac00e08640 1 -- 10.20.193.43:0/1910589538 >> 10.20.193.43:0/1910589538 conn(0x7fabfc08f480 msgr2=0x7fabfc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.461+0000 7fac00e08640 1 -- 10.20.193.43:0/1910589538 shutdown_connections 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.461+0000 7fac00e08640 1 -- 10.20.193.43:0/1910589538 wait complete. 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient: build_initial_monmap 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient: monmap: 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:36.473 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 librados: starting msgr at 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 librados: starting objecter 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 Processor -- start 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 -- start start 2026-02-21T01:33:36.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 librados: setting wanted keys 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 librados: calling monclient init 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient: init 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient(hunting): picked mon.noname-c con 0x7fabfc08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient(hunting): picked mon.noname-b con 0x7fabfc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient(hunting): picked mon.noname-a con 0x7fabfc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc05e1b0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc14c960 con 0x7fabfc08d8d0 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc088000 con 0x7fabfc08d4d0 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:36.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fac00e08640 10 monclient(hunting): authenticate will time out at 948.167766s 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fabfa575640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabfc11ef70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fabfad76640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fabfc08ddb0 0x7fabfc191ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:57458/0 (socket says 10.20.193.43:57458) 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fabfad76640 1 -- 10.20.193.43:0/378244273 learned_addr learned my addr 10.20.193.43:0/378244273 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fabe2ffd640 10 client.?.objecter ms_handle_connect 0x7fabfc08ddb0 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.462+0000 7fabe2ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892216742 0 0) 0x7fabfc05e1b0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): my global_id is 25098 2026-02-21T01:33:36.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabc8003610 con 0x7fabfc08ddb0 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 client.?.objecter ms_handle_connect 0x7fabfc08d8d0 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 104167970 0 0) 0x7fabc8003610 con 0x7fabfc08ddb0 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fabfc05e1b0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fabec0033d0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): dump: 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.477 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.478 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.478 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.478 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.478 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.478 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.478 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.478 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.479 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:36.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1080885717 0 0) 0x7fabfc05e1b0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 >> v1:10.20.193.43:6790/0 conn(0x7fabfc08d4d0 legacy=0x7fabfc11ef70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:33:36.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 >> v1:10.20.193.46:6789/0 conn(0x7fabfc08d8d0 legacy=0x7fabfc1907c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:33:36.479 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 monclient: found mon.a 2026-02-21T01:33:36.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:36.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc10d0a0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient: _finish_auth 0 2026-02-21T01:33:36.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:33:36.480 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fabe2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:36.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 5 monclient: authenticate success, global_id 25098 2026-02-21T01:33:36.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 monclient: _renew_subs 2026-02-21T01:33:36.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc11f680 con 0x7fabfc08ddb0 2026-02-21T01:33:36.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 client.25098.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:36.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 monclient: _renew_subs 2026-02-21T01:33:36.481 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fabfc14c5a0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 1 librados: init done 2026-02-21T01:33:36.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:36.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:36.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.463+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc10d2e0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.482 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fabec003a30 con 0x7fabfc08ddb0 2026-02-21T01:33:36.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabe2ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:36.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fabec003e00 con 0x7fabfc08ddb0 2026-02-21T01:33:36.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabe2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:36.483 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabe2ffd640 10 monclient: dump: 2026-02-21T01:33:36.483 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.483 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.484 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.484 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.484 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.484 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.484 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.484 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.485 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.485 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabf8d72640 4 set_mon_vals no callback set 2026-02-21T01:33:36.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.464+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fabec003fa0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.465+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(293..293 src has 1..293) ==== 5171+0+0 (unknown 532619547 0 0) 0x7fabec04e690 con 0x7fabfc08ddb0 2026-02-21T01:33:36.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.465+0000 7fabe2ffd640 10 client.25098.objecter ms_dispatch2 0x7fabfc000b90 osd_map(293..293 src has 1..293) 2026-02-21T01:33:36.485 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.465+0000 7fabe2ffd640 3 client.25098.objecter handle_osd_map got epochs [293,293] > 0 2026-02-21T01:33:36.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.465+0000 7fabe2ffd640 3 client.25098.objecter handle_osd_map decoding full epoch 293 2026-02-21T01:33:36.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.465+0000 7fabe2ffd640 20 client.25098.objecter dump_active .. 0 homeless 2026-02-21T01:33:36.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.465+0000 7fabfa575640 10 monclient: get_auth_request con 0x7fabc803e910 auth_method 0 2026-02-21T01:33:36.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.465+0000 7fabe2ffd640 10 client.25098.objecter ms_handle_connect 0x7fabc803e910 2026-02-21T01:33:36.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.466+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fabec0179f0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.466+0000 7fabe2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:36.486 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.466+0000 7fabe2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:36.618 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.616+0000 7fac00e08640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:33:36.618 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.616+0000 7fac00e08640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:36.618 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.616+0000 7fac00e08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.618 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.616+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fabfc054ff0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.618 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.616+0000 7fabe2ffd640 1 -- 10.20.193.43:0/378244273 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1460 (unknown 254746657 0 2550960870) 0x7fabec0172f0 con 0x7fabfc08ddb0 2026-02-21T01:33:36.618 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.616+0000 7fabe2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:33:36.618 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.616+0000 7fabe2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:36.619 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":30,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:33:36.620 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 10 librados: watch_flush enter 2026-02-21T01:33:36.620 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 10 librados: watch_flush exit 2026-02-21T01:33:36.620 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 20 client.25098.objecter shutdown clearing up homeless session... 2026-02-21T01:33:36.620 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 10 client.25098.objecter successfully canceled tick 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 >> v1:10.20.193.46:6812/860801619 conn(0x7fabc803e910 legacy=0x7fabc805edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 10 monclient: shutdown 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 >> v1:10.20.193.43:6789/0 conn(0x7fabfc08ddb0 legacy=0x7fabfc191ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 shutdown_connections 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 >> 10.20.193.43:0/378244273 conn(0x7fabfc08f480 msgr2=0x7fabfc05a820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 shutdown_connections 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.617+0000 7fac00e08640 1 -- 10.20.193.43:0/378244273 wait complete. 2026-02-21T01:33:36.621 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.618+0000 7fac00e08640 1 librados: shutdown 2026-02-21T01:33:36.628 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-21T01:33:36.628 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-21T01:33:36.629 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:33:36.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.696+0000 7fb0f8f78640 10 monclient: get_monmap_and_config 2026-02-21T01:33:36.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.696+0000 7fb0f8f78640 10 monclient: build_initial_monmap 2026-02-21T01:33:36.711 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.696+0000 7fb0f8f78640 10 monclient: monmap: 2026-02-21T01:33:36.711 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:36.711 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.712 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:36.696865+0000 2026-02-21T01:33:36.712 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:36.696865+0000 2026-02-21T01:33:36.712 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:36.712 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.712 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:36.712 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:36.712 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:36.713 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.696+0000 7fb0f8f78640 1 Processor -- start 2026-02-21T01:33:36.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.696+0000 7fb0f8f78640 1 -- start start 2026-02-21T01:33:36.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.696+0000 7fb0f8f78640 10 monclient: init 2026-02-21T01:33:36.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:36.713 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:36.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient(hunting): picked mon.noname-a con 0x7fb0f408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:36.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient(hunting): picked mon.noname-c con 0x7fb0f408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:36.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient(hunting): picked mon.noname-b con 0x7fb0f408d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:36.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f408a690 con 0x7fb0f408ddb0 2026-02-21T01:33:36.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f408b910 con 0x7fb0f408d4d0 2026-02-21T01:33:36.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f4088ae0 con 0x7fb0f408d8d0 2026-02-21T01:33:36.714 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:36.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient(hunting): authenticate will time out at 948.402308s 2026-02-21T01:33:36.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f2d76640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fb0f408d8d0 legacy=0x7fb0f419f7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:36.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f2575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fb0f408ddb0 0x7fb0f408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:57464/0 (socket says 10.20.193.43:57464) 2026-02-21T01:33:36.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f2575640 1 -- 10.20.193.43:0/2306786736 learned_addr learned my addr 10.20.193.43:0/2306786736 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:36.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100564284 0 0) 0x7fb0f408a690 con 0x7fb0f408ddb0 2026-02-21T01:33:36.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.715 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient(hunting): my global_id is 25101 2026-02-21T01:33:36.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e0003610 con 0x7fb0f408ddb0 2026-02-21T01:33:36.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3189147751 0 0) 0x7fb0e0003610 con 0x7fb0f408ddb0 2026-02-21T01:33:36.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 >> v1:10.20.193.43:6790/0 conn(0x7fb0f408d8d0 legacy=0x7fb0f419f7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:33:36.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 >> v1:10.20.193.46:6789/0 conn(0x7fb0f408d4d0 legacy=0x7fb0f417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.716 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: _finish_hunting 0 2026-02-21T01:33:36.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 monclient: found mon.noname-a 2026-02-21T01:33:36.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:36.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f41a3ef0 con 0x7fb0f408ddb0 2026-02-21T01:33:36.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: _finish_auth 0 2026-02-21T01:33:36.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: _check_auth_tickets 2026-02-21T01:33:36.717 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:36.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb0e8002df0 con 0x7fb0f408ddb0 2026-02-21T01:33:36.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:36.718 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: dump: 2026-02-21T01:33:36.718 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.718 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.718 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.719 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.719 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.719 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.719 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.719 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.719 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.720 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 5 monclient: authenticate success, global_id 25101 2026-02-21T01:33:36.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:36.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0e8003070 con 0x7fb0f408ddb0 2026-02-21T01:33:36.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:36.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 1 -- 10.20.193.43:0/2306786736 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb0e80034b0 con 0x7fb0f408ddb0 2026-02-21T01:33:36.720 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:36.721 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f1573640 10 monclient: dump: 2026-02-21T01:33:36.721 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.721 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.721 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.721 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.722 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.722 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.722 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.722 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.722 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.722 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.722 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:36.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 4 set_mon_vals no callback set 2026-02-21T01:33:36.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 10 monclient: shutdown 2026-02-21T01:33:36.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:36.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.697+0000 7fb0f8f78640 1 -- 10.20.193.43:0/2306786736 >> v1:10.20.193.43:6789/0 conn(0x7fb0f408ddb0 legacy=0x7fb0f408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 -- 10.20.193.43:0/2306786736 shutdown_connections 2026-02-21T01:33:36.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 -- 10.20.193.43:0/2306786736 >> 10.20.193.43:0/2306786736 conn(0x7fb0f408f480 msgr2=0x7fb0f408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:36.723 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 -- 10.20.193.43:0/2306786736 shutdown_connections 2026-02-21T01:33:36.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 -- 10.20.193.43:0/2306786736 wait complete. 2026-02-21T01:33:36.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 10 monclient: build_initial_monmap 2026-02-21T01:33:36.724 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 10 monclient: monmap: 2026-02-21T01:33:36.724 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:36.724 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:36.724 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:36.724 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 librados: starting msgr at 2026-02-21T01:33:36.725 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 librados: starting objecter 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 Processor -- start 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 -- start start 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 librados: setting wanted keys 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 1 librados: calling monclient init 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.698+0000 7fb0f8f78640 10 monclient: init 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient(hunting): picked mon.noname-a con 0x7fb0f408d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:36.726 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient(hunting): picked mon.noname-b con 0x7fb0f408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient(hunting): picked mon.noname-c con 0x7fb0f408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f41279a0 con 0x7fb0f408d4d0 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f40873b0 con 0x7fb0f408d8d0 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f4088260 con 0x7fb0f408ddb0 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient(hunting): authenticate will time out at 948.404278s 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f2d76640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7fb0f408ddb0 legacy=0x7fb0f419b900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f2575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fb0f408d4d0 0x7fb0f4086590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:57468/0 (socket says 10.20.193.43:57468) 2026-02-21T01:33:36.727 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f2575640 1 -- 10.20.193.43:0/3438705011 learned_addr learned my addr 10.20.193.43:0/3438705011 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 client.?.objecter ms_handle_connect 0x7fb0f408d4d0 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296622372 0 0) 0x7fb0f41279a0 con 0x7fb0f408d4d0 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): my global_id is 25104 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c0003610 con 0x7fb0f408d4d0 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 client.?.objecter ms_handle_connect 0x7fb0f408d8d0 2026-02-21T01:33:36.728 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424600899 0 0) 0x7fb0f40873b0 con 0x7fb0f408d8d0 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): my global_id is 84316 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0f41279a0 con 0x7fb0f408d8d0 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 341685606 0 0) 0x7fb0c0003610 con 0x7fb0f408d4d0 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0f40873b0 con 0x7fb0f408d4d0 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb0e8002d00 con 0x7fb0f408d4d0 2026-02-21T01:33:36.729 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): dump: 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.730 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2538718959 0 0) 0x7fb0f40873b0 con 0x7fb0f408d4d0 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.43:6790/0 conn(0x7fb0f408ddb0 legacy=0x7fb0f419b900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.46:6789/0 conn(0x7fb0f408d8d0 legacy=0x7fb0f4086ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: _finish_hunting 0 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 monclient: found mon.a 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f4057150 con 0x7fb0f408d4d0 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: _finish_auth 0 2026-02-21T01:33:36.731 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: _check_auth_tickets 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 5 monclient: authenticate success, global_id 25104 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient: _renew_subs 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f405e1b0 con 0x7fb0f408d4d0 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 client.25104.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient: _renew_subs 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0f4127c80 con 0x7fb0f408d4d0 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f8f78640 1 librados: init done 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0e8002f50 con 0x7fb0f408d4d0 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb0e8004e80 con 0x7fb0f408d4d0 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.732 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0f0d72640 4 set_mon_vals no callback set 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.699+0000 7fb0daffd640 10 monclient: dump: 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0f8f78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:36.733 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb0f408edb0 con 0x7fb0f41a10d0 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 client.25104.objecter ms_handle_connect 0x7fb0f41a10d0 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 client.25104.objecter resend_mon_ops 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fb0e8011800 con 0x7fb0f408d4d0 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(293..293 src has 1..293) ==== 5171+0+0 (unknown 532619547 0 0) 0x7fb0e804e2f0 con 0x7fb0f408d4d0 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 client.25104.objecter ms_dispatch2 0x7fb0f4000b90 osd_map(293..293 src has 1..293) 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 3 client.25104.objecter handle_osd_map got epochs [293,293] > 0 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 3 client.25104.objecter handle_osd_map decoding full epoch 293 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 20 client.25104.objecter dump_active .. 0 homeless 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891010193 0 0) 0x7fb0f408edb0 con 0x7fb0f41a10d0 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient(hunting): my global_id is 25107 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0f40873b0 con 0x7fb0f41a10d0 2026-02-21T01:33:36.734 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4199637763 0 0) 0x7fb0f40873b0 con 0x7fb0f41a10d0 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0f408edb0 con 0x7fb0f41a10d0 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb0dc003710 con 0x7fb0f41a10d0 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient: dump: 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.735 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2115200847 0 0) 0x7fb0f408edb0 con 0x7fb0f41a10d0 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0f40008d0 con 0x7fb0f41a10d0 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0f2d76640 10 monclient: get_auth_request con 0x7fb0c003e510 auth_method 0 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb0dc003640 con 0x7fb0f41a10d0 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.43:6789/0 conn(0x7fb0f41a10d0 legacy=0x7fb0f40592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.700+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.43:6789/0 conn(0x7fb0f41a10d0 legacy=0x7fb0f40592f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.701+0000 7fb0daffd640 10 client.25104.objecter ms_handle_connect 0x7fb0c003e510 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.703+0000 7fb0f8f78640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb0f4126830 con 0x7fb0f4059a00 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 client.25104.objecter ms_handle_connect 0x7fb0f4059a00 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 client.25104.objecter resend_mon_ops 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815385919 0 0) 0x7fb0f4126830 con 0x7fb0f4059a00 2026-02-21T01:33:36.736 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient(hunting): my global_id is 25110 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0f408edb0 con 0x7fb0f4059a00 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1722343792 0 0) 0x7fb0f408edb0 con 0x7fb0f4059a00 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0f4126830 con 0x7fb0f4059a00 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fb0dc003da0 con 0x7fb0f4059a00 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient: dump: 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.737 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3390626680 0 0) 0x7fb0f4126830 con 0x7fb0f4059a00 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb0f41150e0 con 0x7fb0f4059a00 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4307 (unknown 0 0 2796638310) 0x7fb0dc003e10 con 0x7fb0f4059a00 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.43:6789/0 conn(0x7fb0f4059a00 legacy=0x7fb0f41129b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.738 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0daffd640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.43:6789/0 conn(0x7fb0f4059a00 legacy=0x7fb0f41129b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 30, 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 352334, 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: 1 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:36.739 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.740 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:36.741 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:36.742 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:36.743 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.744 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:36.745 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:36.746 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.747 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:36.748 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:36.749 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 10 librados: watch_flush enter 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 10 librados: watch_flush exit 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 20 client.25104.objecter shutdown clearing up homeless session... 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 10 client.25104.objecter successfully canceled tick 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.46:6812/860801619 conn(0x7fb0c003e510 legacy=0x7fb0c005e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 10 monclient: shutdown 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 >> v1:10.20.193.43:6789/0 conn(0x7fb0f408d4d0 legacy=0x7fb0f4086590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f2d76640 1 -- 10.20.193.43:0/3438705011 reap_dead start 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f2d76640 1 -- 10.20.193.43:0/3438705011 reap_dead start 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 shutdown_connections 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 >> 10.20.193.43:0/3438705011 conn(0x7fb0f408f480 msgr2=0x7fb0f411f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 shutdown_connections 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 -- 10.20.193.43:0/3438705011 wait complete. 2026-02-21T01:33:36.750 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.704+0000 7fb0f8f78640 1 librados: shutdown 2026-02-21T01:33:36.751 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:33:36.751 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-21T01:33:36.751 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:33:36.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient: get_monmap_and_config 2026-02-21T01:33:36.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient: build_initial_monmap 2026-02-21T01:33:36.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient: monmap: 2026-02-21T01:33:36.820 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:36.820 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:33:36.820489+0000 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:33:36.820489+0000 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:33:36.821 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 1 Processor -- start 2026-02-21T01:33:36.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 1 -- start start 2026-02-21T01:33:36.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient: init 2026-02-21T01:33:36.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:36.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:33:36.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient(hunting): picked mon.noname-a con 0x7ff5fc058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient(hunting): picked mon.noname-c con 0x7ff5fc057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient(hunting): picked mon.noname-b con 0x7ff5fc181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc056c50 con 0x7ff5fc058260 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc08eda0 con 0x7ff5fc057630 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc08f5c0 con 0x7ff5fc181e80 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff60368b640 10 monclient(hunting): authenticate will time out at 948.525960s 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.820+0000 7ff601c01640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7ff5fc181e80 legacy=0x7ff5fc1a2260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff601400640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff5fc058260 0x7ff5fc08df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:57500/0 (socket says 10.20.193.43:57500) 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff601400640 1 -- 10.20.193.43:0/2665777131 learned_addr learned my addr 10.20.193.43:0/2665777131 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160702172 0 0) 0x7ff5fc056c50 con 0x7ff5fc058260 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.830 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient(hunting): my global_id is 25113 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e4003610 con 0x7ff5fc058260 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577882100 0 0) 0x7ff5e4003610 con 0x7ff5fc058260 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 >> v1:10.20.193.43:6790/0 conn(0x7ff5fc181e80 legacy=0x7ff5fc1a2260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 >> v1:10.20.193.46:6789/0 conn(0x7ff5fc057630 legacy=0x7ff5fc08e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: _finish_hunting 0 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 monclient: found mon.noname-a 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc0563b0 con 0x7ff5fc058260 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: _finish_auth 0 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: _check_auth_tickets 2026-02-21T01:33:36.831 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff5ec002df0 con 0x7ff5fc058260 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 5 monclient: authenticate success, global_id 25113 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: dump: 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.832 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5ec003040 con 0x7ff5fc058260 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 1 -- 10.20.193.43:0/2665777131 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff5ec003480 con 0x7ff5fc058260 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff5ebfff640 10 monclient: dump: 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.833 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 10 monclient: get_monmap_and_config success 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 4 set_mon_vals no callback set 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 10 monclient: shutdown 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 1 -- 10.20.193.43:0/2665777131 >> v1:10.20.193.43:6789/0 conn(0x7ff5fc058260 legacy=0x7ff5fc08df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 1 -- 10.20.193.43:0/2665777131 shutdown_connections 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 1 -- 10.20.193.43:0/2665777131 >> 10.20.193.43:0/2665777131 conn(0x7ff5fc090360 msgr2=0x7ff5fc090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 1 -- 10.20.193.43:0/2665777131 shutdown_connections 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.821+0000 7ff60368b640 1 -- 10.20.193.43:0/2665777131 wait complete. 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: build_initial_monmap 2026-02-21T01:33:36.834 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: monmap: 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 librados: starting msgr at 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 librados: starting objecter 2026-02-21T01:33:36.835 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 Processor -- start 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 -- start start 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 librados: setting wanted keys 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 librados: calling monclient init 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: init 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: _reopen_session rank -1 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient(hunting): picked mon.noname-a con 0x7ff5fc057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient(hunting): picked mon.noname-c con 0x7ff5fc058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient(hunting): picked mon.noname-b con 0x7ff5fc181e80 addr v1:10.20.193.46:6789/0 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc149570 con 0x7ff5fc057630 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc08a870 con 0x7ff5fc181e80 2026-02-21T01:33:36.836 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc12f950 con 0x7ff5fc058260 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient(hunting): _renew_subs 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient(hunting): authenticate will time out at 948.527534s 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff600bff640 1 -- >> v1:10.20.193.43:6790/0 conn(0x7ff5fc058260 legacy=0x7ff5fc170210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.43:6790/0 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff601400640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff5fc057630 0x7ff5fc148e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:57516/0 (socket says 10.20.193.43:57516) 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff601400640 1 -- 10.20.193.43:0/3656284906 learned_addr learned my addr 10.20.193.43:0/3656284906 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 client.?.objecter ms_handle_connect 0x7ff5fc057630 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72339014 0 0) 0x7ff5fc149570 con 0x7ff5fc057630 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): my global_id is 25116 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5cc003610 con 0x7ff5fc057630 2026-02-21T01:33:36.837 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 client.?.objecter ms_handle_connect 0x7ff5fc181e80 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 394118334 0 0) 0x7ff5cc003610 con 0x7ff5fc057630 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5fc149570 con 0x7ff5fc057630 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff5ec003390 con 0x7ff5fc057630 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): dump: 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.838 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3913888342 0 0) 0x7ff5fc149570 con 0x7ff5fc057630 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.43:6790/0 conn(0x7ff5fc058260 legacy=0x7ff5fc170210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.46:6789/0 conn(0x7ff5fc181e80 legacy=0x7ff5fc171930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 monclient: found mon.a 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc12e460 con 0x7ff5fc057630 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: _finish_auth 0 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:33:36.839 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 5 monclient: authenticate success, global_id 25116 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: _renew_subs 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc1307c0 con 0x7ff5fc057630 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 client.25116.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: _renew_subs 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5fc12f1a0 con 0x7ff5fc057630 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff60368b640 1 librados: init done 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5ec003020 con 0x7ff5fc057630 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff5ec004ce0 con 0x7ff5fc057630 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5eb7fe640 4 set_mon_vals no callback set 2026-02-21T01:33:36.840 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.822+0000 7ff5e9ffb640 10 monclient: dump: 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff60368b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5fc14c1f0 con 0x7ff5fc14be20 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff5ec011660 con 0x7ff5fc057630 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(293..293 src has 1..293) ==== 5171+0+0 (unknown 532619547 0 0) 0x7ff5ec04e400 con 0x7ff5fc057630 2026-02-21T01:33:36.841 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 10 client.25116.objecter ms_dispatch2 0x7ff5fc000b90 osd_map(293..293 src has 1..293) 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 3 client.25116.objecter handle_osd_map got epochs [293,293] > 0 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 3 client.25116.objecter handle_osd_map decoding full epoch 293 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 20 client.25116.objecter dump_active .. 0 homeless 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 10 client.25116.objecter ms_handle_connect 0x7ff5fc14be20 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff5e9ffb640 10 client.25116.objecter resend_mon_ops 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.823+0000 7ff601c01640 10 monclient: get_auth_request con 0x7ff5cc03e830 auth_method 0 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1539854886 0 0) 0x7ff5fc14c1f0 con 0x7ff5fc14be20 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient(hunting): my global_id is 84325 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5fc149570 con 0x7ff5fc14be20 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2226817261 0 0) 0x7ff5fc149570 con 0x7ff5fc14be20 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5fc14c1f0 con 0x7ff5fc14be20 2026-02-21T01:33:36.842 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 client.25116.objecter ms_handle_connect 0x7ff5cc03e830 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff5f00030b0 con 0x7ff5fc14be20 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient: dump: 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.843 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3520188550 0 0) 0x7ff5fc14c1f0 con 0x7ff5fc14be20 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5fc0008d0 con 0x7ff5fc14be20 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff5f00030f0 con 0x7ff5fc14be20 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.46:6789/0 conn(0x7ff5fc14be20 legacy=0x7ff5fc087190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.824+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.46:6789/0 conn(0x7ff5fc14be20 legacy=0x7ff5fc087190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.827+0000 7ff60368b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.827+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5fc092830 con 0x7ff5fc0878a0 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 client.25116.objecter ms_handle_connect 0x7ff5fc0878a0 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 client.25116.objecter resend_mon_ops 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857523129 0 0) 0x7ff5fc092830 con 0x7ff5fc0878a0 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:33:36.844 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 monclient(hunting): my global_id is 84328 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5fc14c1f0 con 0x7ff5fc0878a0 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1192930584 0 0) 0x7ff5fc14c1f0 con 0x7ff5fc0878a0 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5fc092830 con 0x7ff5fc0878a0 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff5f0004a20 con 0x7ff5fc0878a0 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 10 monclient: dump: 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:33:36.845 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1914719382 0 0) 0x7ff5fc092830 con 0x7ff5fc0878a0 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.828+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff5fc12e070 con 0x7ff5fc0878a0 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4472 (unknown 0 0 2964440535) 0x7ff5f0004960 con 0x7ff5fc0878a0 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff5e9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff5e9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.46:6789/0 conn(0x7ff5fc0878a0 legacy=0x7ff5fc174060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.846 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff5e9ffb640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.46:6789/0 conn(0x7ff5fc0878a0 legacy=0x7ff5fc174060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 30, 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 123846, 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: 1 2026-02-21T01:33:36.847 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:36.848 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:36.849 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:36.850 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:33:36.851 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:33:36.852 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.853 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:36.854 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:33:36.855 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:36.856 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:33:36.857 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:33:36.858 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:33:36.858 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:33:36.858 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:33:36.858 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:33:36.858 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:33:36.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 10 librados: watch_flush enter 2026-02-21T01:33:36.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 10 librados: watch_flush exit 2026-02-21T01:33:36.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 20 client.25116.objecter shutdown clearing up homeless session... 2026-02-21T01:33:36.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 10 client.25116.objecter successfully canceled tick 2026-02-21T01:33:36.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.46:6812/860801619 conn(0x7ff5cc03e830 legacy=0x7ff5cc05ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 10 monclient: shutdown 2026-02-21T01:33:36.859 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 >> v1:10.20.193.43:6789/0 conn(0x7ff5fc057630 legacy=0x7ff5fc148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff601c01640 1 -- 10.20.193.43:0/3656284906 reap_dead start 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff601c01640 1 -- 10.20.193.43:0/3656284906 reap_dead start 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 shutdown_connections 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 >> 10.20.193.43:0/3656284906 conn(0x7ff5fc090360 msgr2=0x7ff5fc08aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 shutdown_connections 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 1 -- 10.20.193.43:0/3656284906 wait complete. 2026-02-21T01:33:36.860 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:33:36.829+0000 7ff60368b640 1 librados: shutdown 2026-02-21T01:33:36.860 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-21T01:33:36.860 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-21T01:34:03.455 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-21T01:34:03.455 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7006 ms) 2026-02-21T01:34:03.455 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-21T01:34:03.455 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (2994 ms) 2026-02-21T01:34:03.455 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7018 ms) 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6993 ms) 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (21024 ms) 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (6969 ms) 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7017 ms) 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-21T01:34:03.456 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6994 ms) 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (167017 ms total) 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-21T01:34:03.457 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (1 ms) 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (0 ms) 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (1 ms total) 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (341306 ms total) 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-21T01:34:03.458 INFO:tasks.workunit.client.0.trial046.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45006 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45006 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45962 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45962 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45184 2026-02-21T01:34:03.462 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45184 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46038 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 46038 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45320 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45320 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45799 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45799 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46128 2026-02-21T01:34:03.463 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 46128 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45221 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45221 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45661 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45661 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45905 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45905 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45765 2026-02-21T01:34:03.464 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45765 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46008 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 46008 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45571 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45571 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45136 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45136 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46082 2026-02-21T01:34:03.465 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 46082 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45438 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45438 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=44978 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 44978 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45040 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45040 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45377 2026-02-21T01:34:03.466 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45377 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45079 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45079 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45479 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45479 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45500 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45500 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=45877 2026-02-21T01:34:03.467 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 45877 2026-02-21T01:34:03.468 INFO:tasks.workunit.client.0.trial046.stderr:+ for t in "${!pids[@]}" 2026-02-21T01:34:03.468 INFO:tasks.workunit.client.0.trial046.stderr:+ pid=46193 2026-02-21T01:34:03.468 INFO:tasks.workunit.client.0.trial046.stderr:+ wait 46193 2026-02-21T01:34:03.468 INFO:tasks.workunit.client.0.trial046.stderr:+ exit 0 2026-02-21T01:34:03.468 INFO:tasks.workunit.client.0.trial046.stderr:+ cleanup 2026-02-21T01:34:03.468 INFO:tasks.workunit.client.0.trial046.stderr:+ pkill -P 44972 2026-02-21T01:34:03.469 INFO:tasks.workunit.client.0.trial046.stderr:+ true 2026-02-21T01:34:03.469 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-21T01:34:03.470 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-21T01:34:03.535 INFO:tasks.workunit:Stopping ['rados/test.sh unit_test_scan'] on client.0... 2026-02-21T01:34:03.536 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-21T01:34:03.883 DEBUG:teuthology.parallel:result is None 2026-02-21T01:34:03.883 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-21T01:34:03.907 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-21T01:34:03.907 DEBUG:teuthology.orchestra.run.trial046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-21T01:34:03.963 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-21T01:34:03.963 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-21T01:34:03.973 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-21T01:35:06.861 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-21T01:35:06.867 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-21T01:35:06.867 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-21T01:35:06.881 INFO:tasks.ceph.mon.c:Started 2026-02-21T01:35:06.881 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:35:06.881 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:35:06.949 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.948+0000 7fa4663cf640 10 monclient: get_monmap_and_config 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.948+0000 7fa4663cf640 10 monclient: build_initial_monmap 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.948+0000 7fa4663cf640 10 monclient: monmap: 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:06.949885+0000 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:06.949885+0000 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:06.950 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:06.951 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:06.951 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:06.951 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:06.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 1 Processor -- start 2026-02-21T01:35:06.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 1 -- start start 2026-02-21T01:35:06.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient: init 2026-02-21T01:35:06.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:06.958 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient(hunting): picked mon.noname-c con 0x7fa460058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient(hunting): picked mon.noname-b con 0x7fa460057630 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient(hunting): picked mon.noname-a con 0x7fa460181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa460056c50 con 0x7fa460181e80 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46008eda0 con 0x7fa460058260 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46008f5c0 con 0x7fa460057630 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa4663cf640 10 monclient(hunting): authenticate will time out at 1038.655689s 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa45f7fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fa460057630 0x7fa46008e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58242/0 (socket says 10.20.193.43:58242) 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.949+0000 7fa45f7fe640 1 -- 10.20.193.43:0/1043451582 learned_addr learned my addr 10.20.193.43:0/1043451582 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:06.959 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339953710 0 0) 0x7fa46008eda0 con 0x7fa460058260 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient(hunting): my global_id is 84355 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa444003610 con 0x7fa460058260 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3003626600 0 0) 0x7fa444003610 con 0x7fa460058260 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 >> v1:10.20.193.43:6790/0 conn(0x7fa460057630 legacy=0x7fa46008e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 >> v1:10.20.193.43:6789/0 conn(0x7fa460181e80 legacy=0x7fa4601a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 monclient: found mon.noname-c 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:06.960 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4600563b0 con 0x7fa460058260 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: _finish_auth 0 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa44c002df0 con 0x7fa460058260 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: dump: 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.961 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 5 monclient: authenticate success, global_id 84355 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa44c003080 con 0x7fa460058260 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 4 set_mon_vals no callback set 2026-02-21T01:35:06.962 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 1 -- 10.20.193.43:0/1043451582 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa44c003480 con 0x7fa460058260 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa45effd640 10 monclient: dump: 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:06.963 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 10 monclient: shutdown 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 1 -- 10.20.193.43:0/1043451582 >> v1:10.20.193.46:6789/0 conn(0x7fa460058260 legacy=0x7fa46008df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 1 -- 10.20.193.43:0/1043451582 shutdown_connections 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 1 -- 10.20.193.43:0/1043451582 >> 10.20.193.43:0/1043451582 conn(0x7fa460090360 msgr2=0x7fa460090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 1 -- 10.20.193.43:0/1043451582 shutdown_connections 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.950+0000 7fa4663cf640 1 -- 10.20.193.43:0/1043451582 wait complete. 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient: build_initial_monmap 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient: monmap: 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:06.964 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 librados: starting msgr at 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 librados: starting objecter 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 Processor -- start 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 -- start start 2026-02-21T01:35:06.965 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 librados: setting wanted keys 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 librados: calling monclient init 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient: init 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient(hunting): picked mon.noname-b con 0x7fa460057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient(hunting): picked mon.noname-c con 0x7fa460058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient(hunting): picked mon.noname-a con 0x7fa460181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46010e9f0 con 0x7fa460181e80 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa460128610 con 0x7fa460057630 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46008a870 con 0x7fa460058260 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:06.966 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa4663cf640 10 monclient(hunting): authenticate will time out at 1038.657869s 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa464945640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fa460181e80 0x7fa4601709e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:32996/0 (socket says 10.20.193.43:32996) 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa464945640 1 -- 10.20.193.43:0/3273115011 learned_addr learned my addr 10.20.193.43:0/3273115011 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa45cff9640 10 client.?.objecter ms_handle_connect 0x7fa460181e80 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa45cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa45cff9640 10 client.?.objecter ms_handle_connect 0x7fa460058260 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.951+0000 7fa45cff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513569603 0 0) 0x7fa46010e9f0 con 0x7fa460181e80 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): my global_id is 25131 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa430003610 con 0x7fa460181e80 2026-02-21T01:35:06.967 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4248683738 0 0) 0x7fa430003610 con 0x7fa460181e80 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa46010e9f0 con 0x7fa460181e80 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa4540033d0 con 0x7fa460181e80 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): dump: 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:06.968 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1088388903 0 0) 0x7fa46010e9f0 con 0x7fa460181e80 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 >> v1:10.20.193.43:6790/0 conn(0x7fa460058260 legacy=0x7fa46016f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 >> v1:10.20.193.46:6789/0 conn(0x7fa460057630 legacy=0x7fa460127f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: _finish_hunting 0 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 monclient: found mon.a 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:06.969 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46010d500 con 0x7fa460181e80 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: _finish_auth 0 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: _check_auth_tickets 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 5 monclient: authenticate success, global_id 25131 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 monclient: _renew_subs 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa46010f860 con 0x7fa460181e80 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 client.25131.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 monclient: _renew_subs 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa46010e240 con 0x7fa460181e80 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 1 librados: init done 2026-02-21T01:35:06.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa454003ac0 con 0x7fa460181e80 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa454003e90 con 0x7fa460181e80 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 10 monclient: dump: 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:06.971 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45e7fc640 4 set_mon_vals no callback set 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46010f0d0 con 0x7fa460181e80 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.952+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fa454004030 con 0x7fa460181e80 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.953+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7fa45404e3b0 con 0x7fa460181e80 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.953+0000 7fa45cff9640 10 client.25131.objecter ms_dispatch2 0x7fa460000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.953+0000 7fa45cff9640 3 client.25131.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:06.972 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.953+0000 7fa45cff9640 3 client.25131.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:06.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.953+0000 7fa45cff9640 20 client.25131.objecter dump_active .. 0 homeless 2026-02-21T01:35:06.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.953+0000 7fa45ffff640 10 monclient: get_auth_request con 0x7fa43003e8f0 auth_method 0 2026-02-21T01:35:06.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.953+0000 7fa45cff9640 10 client.25131.objecter ms_handle_connect 0x7fa43003e8f0 2026-02-21T01:35:06.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.955+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa454017a30 con 0x7fa460181e80 2026-02-21T01:35:06.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.956+0000 7fa45cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:06.973 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:06.956+0000 7fa45cff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.105+0000 7fa4663cf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.105+0000 7fa4663cf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.105+0000 7fa4663cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.105+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa46008c480 con 0x7fa460181e80 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.105+0000 7fa45cff9640 1 -- 10.20.193.43:0/3273115011 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 1361155371) 0x7fa454017330 con 0x7fa460181e80 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.105+0000 7fa45cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.105+0000 7fa45cff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:07.107 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:35:07.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 10 librados: watch_flush enter 2026-02-21T01:35:07.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 10 librados: watch_flush exit 2026-02-21T01:35:07.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 20 client.25131.objecter shutdown clearing up homeless session... 2026-02-21T01:35:07.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 10 client.25131.objecter successfully canceled tick 2026-02-21T01:35:07.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 >> v1:10.20.193.46:6812/860801619 conn(0x7fa43003e8f0 legacy=0x7fa43005eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 10 monclient: shutdown 2026-02-21T01:35:07.109 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 >> v1:10.20.193.43:6789/0 conn(0x7fa460181e80 legacy=0x7fa4601709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 shutdown_connections 2026-02-21T01:35:07.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 >> 10.20.193.43:0/3273115011 conn(0x7fa460090360 msgr2=0x7fa46008d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.106+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 shutdown_connections 2026-02-21T01:35:07.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.107+0000 7fa4663cf640 1 -- 10.20.193.43:0/3273115011 wait complete. 2026-02-21T01:35:07.110 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.107+0000 7fa4663cf640 1 librados: shutdown 2026-02-21T01:35:07.116 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:35:07.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-21T01:35:07.117 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-21T01:35:07.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.182+0000 7fa2bff8a640 10 monclient: get_monmap_and_config 2026-02-21T01:35:07.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.182+0000 7fa2bff8a640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.184 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.182+0000 7fa2bff8a640 10 monclient: monmap: 2026-02-21T01:35:07.184 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.184 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.184 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:07.184226+0000 2026-02-21T01:35:07.185 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:07.184226+0000 2026-02-21T01:35:07.185 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.185 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.185 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.185 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:07.185 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:07.185 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 1 Processor -- start 2026-02-21T01:35:07.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 1 -- start start 2026-02-21T01:35:07.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient: init 2026-02-21T01:35:07.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:35:07.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient(hunting): picked mon.noname-c con 0x7fa2b808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.195 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient(hunting): picked mon.noname-a con 0x7fa2b808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient(hunting): picked mon.noname-b con 0x7fa2b808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b808a690 con 0x7fa2b808d4d0 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b808b910 con 0x7fa2b808ddb0 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b8088ae0 con 0x7fa2b808d8d0 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bff8a640 10 monclient(hunting): authenticate will time out at 1038.889661s 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bd4fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fa2b808d4d0 0x7fa2b817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33006/0 (socket says 10.20.193.43:33006) 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bd4fe640 1 -- 10.20.193.43:0/3228449447 learned_addr learned my addr 10.20.193.43:0/3228449447 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930026848 0 0) 0x7fa2b808a690 con 0x7fa2b808d4d0 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bccfd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bccfd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.196 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bccfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bccfd640 10 monclient(hunting): my global_id is 25134 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.183+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a0003610 con 0x7fa2b808d4d0 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261413913 0 0) 0x7fa2b808b910 con 0x7fa2b808ddb0 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient(hunting): my global_id is 84358 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b808a690 con 0x7fa2b808ddb0 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3809011531 0 0) 0x7fa2b808a690 con 0x7fa2b808ddb0 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 >> v1:10.20.193.43:6790/0 conn(0x7fa2b808d8d0 legacy=0x7fa2b819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 >> v1:10.20.193.43:6789/0 conn(0x7fa2b808d4d0 legacy=0x7fa2b817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.197 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 monclient: found mon.noname-c 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.46:6789/0 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 --> v1:10.20.193.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b81a3ef0 con 0x7fa2b808ddb0 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa2a8002df0 con 0x7fa2b808ddb0 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: dump: 2026-02-21T01:35:07.198 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 5 monclient: authenticate success, global_id 84358 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:07.199 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 <== mon.1 v1:10.20.193.46:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2a80030f0 con 0x7fa2b808ddb0 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 1 -- 10.20.193.43:0/3228449447 <== mon.1 v1:10.20.193.46:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa2a80034f0 con 0x7fa2b808ddb0 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bccfd640 10 monclient: dump: 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.200 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 4 set_mon_vals no callback set 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 10 monclient: shutdown 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 1 -- 10.20.193.43:0/3228449447 >> v1:10.20.193.46:6789/0 conn(0x7fa2b808ddb0 legacy=0x7fa2b808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 1 -- 10.20.193.43:0/3228449447 shutdown_connections 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 1 -- 10.20.193.43:0/3228449447 >> 10.20.193.43:0/3228449447 conn(0x7fa2b808f480 msgr2=0x7fa2b808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 1 -- 10.20.193.43:0/3228449447 shutdown_connections 2026-02-21T01:35:07.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.184+0000 7fa2bff8a640 1 -- 10.20.193.43:0/3228449447 wait complete. 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient: monmap: 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:07.202 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 librados: starting msgr at 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 librados: starting objecter 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 Processor -- start 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 -- start start 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 librados: setting wanted keys 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 librados: calling monclient init 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient: init 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient(hunting): picked mon.noname-a con 0x7fa2b808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient(hunting): picked mon.noname-c con 0x7fa2b808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient(hunting): picked mon.noname-b con 0x7fa2b808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b80573f0 con 0x7fa2b808d4d0 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b810c6e0 con 0x7fa2b808ddb0 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b8087380 con 0x7fa2b808d8d0 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bff8a640 10 monclient(hunting): authenticate will time out at 1038.891903s 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bd4fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fa2b808d8d0 0x7fa2b8086c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58278/0 (socket says 10.20.193.43:58278) 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bd4fe640 1 -- 10.20.193.43:0/2222127239 learned_addr learned my addr 10.20.193.43:0/2222127239 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.185+0000 7fa2bdcff640 1 --1- 10.20.193.43:0/2222127239 >> v1:10.20.193.43:6789/0 conn(0x7fa2b808d4d0 0x7fa2b8086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33020/0 (socket says 10.20.193.43:33020) 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.?.objecter ms_handle_connect 0x7fa2b808d8d0 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.?.objecter ms_handle_connect 0x7fa2b808d4d0 2026-02-21T01:35:07.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461068846 0 0) 0x7fa2b81a3ef0 con 0x7fa2b808d4d0 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): my global_id is 25137 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa288003610 con 0x7fa2b808d4d0 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413619459 0 0) 0x7fa2b8087380 con 0x7fa2b808d8d0 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): my global_id is 104099 2026-02-21T01:35:07.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b81a3ef0 con 0x7fa2b808d8d0 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 934300596 0 0) 0x7fa288003610 con 0x7fa2b808d4d0 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2b8087380 con 0x7fa2b808d4d0 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa2a8002db0 con 0x7fa2b808d4d0 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): dump: 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.206 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.?.objecter ms_handle_connect 0x7fa2b808ddb0 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4003556837 0 0) 0x7fa2b81a3ef0 con 0x7fa2b808d8d0 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa288003610 con 0x7fa2b808d8d0 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa2ac0030b0 con 0x7fa2b808d8d0 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:07.207 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): dump: 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2378184848 0 0) 0x7fa2b8087380 con 0x7fa2b808d4d0 2026-02-21T01:35:07.208 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.43:6790/0 conn(0x7fa2b808d8d0 legacy=0x7fa2b8086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.46:6789/0 conn(0x7fa2b808ddb0 legacy=0x7fa2b818eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 monclient: found mon.a 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b810c9c0 con 0x7fa2b808d4d0 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 5 monclient: authenticate success, global_id 25137 2026-02-21T01:35:07.209 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 10 monclient: _renew_subs 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b805e1b0 con 0x7fa2b808d4d0 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2a8003b10 con 0x7fa2b808d4d0 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 10 client.25137.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 10 monclient: _renew_subs 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa2a8003f20 con 0x7fa2b808d4d0 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2b811e300 con 0x7fa2b808d4d0 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 1 librados: init done 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a7fff640 4 set_mon_vals no callback set 2026-02-21T01:35:07.210 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient: dump: 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.211 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2b808edd0 con 0x7fa2b81a10d0 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.25137.objecter ms_handle_connect 0x7fa2b81a10d0 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 client.25137.objecter resend_mon_ops 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41546175 0 0) 0x7fa2b808edd0 con 0x7fa2b81a10d0 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 10 monclient(hunting): my global_id is 25140 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b8087380 con 0x7fa2b81a10d0 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.186+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fa2a8004140 con 0x7fa2b808d4d0 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7fa2a804dff0 con 0x7fa2b808d4d0 2026-02-21T01:35:07.212 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 10 client.25137.objecter ms_dispatch2 0x7fa2b8000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 3 client.25137.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 3 client.25137.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 20 client.25137.objecter dump_active .. 0 homeless 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4119464656 0 0) 0x7fa2b8087380 con 0x7fa2b81a10d0 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2b808edd0 con 0x7fa2b81a10d0 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa2ac0048d0 con 0x7fa2b81a10d0 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 10 monclient: dump: 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.213 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3066530715 0 0) 0x7fa2b808edd0 con 0x7fa2b81a10d0 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2b8056fc0 con 0x7fa2b81a10d0 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2be500640 10 monclient: get_auth_request con 0x7fa28803e9b0 auth_method 0 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa2ac0059c0 con 0x7fa2b81a10d0 2026-02-21T01:35:07.214 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.43:6789/0 conn(0x7fa2b81a10d0 legacy=0x7fa2b8059600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.43:6789/0 conn(0x7fa2b81a10d0 legacy=0x7fa2b8059600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.187+0000 7fa2a67fc640 10 client.25137.objecter ms_handle_connect 0x7fa28803e9b0 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2bff8a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2b810c220 con 0x7fa2b804ca30 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 client.25137.objecter ms_handle_connect 0x7fa2b804ca30 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 client.25137.objecter resend_mon_ops 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891293888 0 0) 0x7fa288003610 con 0x7fa2b804ca30 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.215 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 monclient(hunting): my global_id is 25143 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b808edd0 con 0x7fa2b804ca30 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3649740045 0 0) 0x7fa2b808edd0 con 0x7fa2b804ca30 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa288003610 con 0x7fa2b804ca30 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fa2ac004f60 con 0x7fa2b804ca30 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 10 monclient: dump: 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.216 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1582277611 0 0) 0x7fa288003610 con 0x7fa2b804ca30 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.190+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 --> v1:10.20.193.43:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2b811e630 con 0x7fa2b804ca30 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 <== mon.0 v1:10.20.193.43:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4318 (unknown 0 0 3141327445) 0x7fa2ac004f80 con 0x7fa2b804ca30 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2a67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2a67fc640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.43:6789/0 conn(0x7fa2b804ca30 legacy=0x7fa2b8191230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.217 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2a67fc640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.43:6789/0 conn(0x7fa2b804ca30 legacy=0x7fa2b8191230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:35:07.218 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:07.218 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:35:07.218 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:35:07.218 INFO:teuthology.orchestra.run.trial043.stdout: "state": "leader", 2026-02-21T01:35:07.218 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 32, 2026-02-21T01:35:07.218 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 442821, 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.219 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.220 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.221 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:35:07.222 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.223 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.224 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.225 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.226 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.227 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: "num": 5 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.228 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.229 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.229 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:35:07.229 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 10 librados: watch_flush enter 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 10 librados: watch_flush exit 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 20 client.25137.objecter shutdown clearing up homeless session... 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 10 client.25137.objecter successfully canceled tick 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.46:6812/860801619 conn(0x7fa28803e9b0 legacy=0x7fa28805ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 10 monclient: shutdown 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 >> v1:10.20.193.43:6789/0 conn(0x7fa2b808d4d0 legacy=0x7fa2b8086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2be500640 1 -- 10.20.193.43:0/2222127239 reap_dead start 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2be500640 1 -- 10.20.193.43:0/2222127239 reap_dead start 2026-02-21T01:35:07.230 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 shutdown_connections 2026-02-21T01:35:07.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 >> 10.20.193.43:0/2222127239 conn(0x7fa2b808f480 msgr2=0x7fa2b811f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 shutdown_connections 2026-02-21T01:35:07.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 1 -- 10.20.193.43:0/2222127239 wait complete. 2026-02-21T01:35:07.231 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.191+0000 7fa2bff8a640 1 librados: shutdown 2026-02-21T01:35:07.231 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:35:07.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-21T01:35:07.231 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-21T01:35:07.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.296+0000 7f904b29f640 10 monclient: get_monmap_and_config 2026-02-21T01:35:07.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.296+0000 7f904b29f640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.310 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.296+0000 7f904b29f640 10 monclient: monmap: 2026-02-21T01:35:07.310 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.310 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.310 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:07.298042+0000 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:07.298042+0000 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 1 Processor -- start 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 1 -- start start 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient: init 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient(hunting): picked mon.noname-c con 0x7f904408ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient(hunting): picked mon.noname-b con 0x7f904408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient(hunting): picked mon.noname-a con 0x7f904408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904408a690 con 0x7f904408d8d0 2026-02-21T01:35:07.311 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904408b910 con 0x7f904408ddb0 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9044088ae0 con 0x7f904408d4d0 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient(hunting): authenticate will time out at 1039.003462s 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9049815640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f904408d8d0 0x7f904419f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33038/0 (socket says 10.20.193.43:33038) 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9049815640 1 -- 10.20.193.43:0/3586413577 learned_addr learned my addr 10.20.193.43:0/3586413577 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049470510 0 0) 0x7f904408a690 con 0x7f904408d8d0 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): my global_id is 25146 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f902c003610 con 0x7f904408d8d0 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995330365 0 0) 0x7f9044088ae0 con 0x7f904408d4d0 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient(hunting): my global_id is 104102 2026-02-21T01:35:07.312 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f904408a690 con 0x7f904408d4d0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2463662883 0 0) 0x7f902c003610 con 0x7f904408d8d0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 >> v1:10.20.193.43:6790/0 conn(0x7f904408d4d0 legacy=0x7f904417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 >> v1:10.20.193.46:6789/0 conn(0x7f904408ddb0 legacy=0x7f904408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 monclient: found mon.noname-a 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90441a3ef0 con 0x7f904408d8d0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 5 monclient: authenticate success, global_id 25146 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9040003170 con 0x7f904408d8d0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: dump: 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.313 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9040003470 con 0x7f904408d8d0 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f904b29f640 4 set_mon_vals no callback set 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 1 -- 10.20.193.43:0/3586413577 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f90400038b0 con 0x7f904408d8d0 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.297+0000 7f9033fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f9033fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f9033fff640 10 monclient: dump: 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.314 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 10 monclient: shutdown 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 -- 10.20.193.43:0/3586413577 >> v1:10.20.193.43:6789/0 conn(0x7f904408d8d0 legacy=0x7f904419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 -- 10.20.193.43:0/3586413577 shutdown_connections 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 -- 10.20.193.43:0/3586413577 >> 10.20.193.43:0/3586413577 conn(0x7f904408f480 msgr2=0x7f904408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 -- 10.20.193.43:0/3586413577 shutdown_connections 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 -- 10.20.193.43:0/3586413577 wait complete. 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 10 monclient: monmap: 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.315 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 librados: starting msgr at 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 librados: starting objecter 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.298+0000 7f904b29f640 1 Processor -- start 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 -- start start 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 librados: setting wanted keys 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 librados: calling monclient init 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient: init 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient(hunting): picked mon.noname-c con 0x7f904408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient(hunting): picked mon.noname-a con 0x7f904408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient(hunting): picked mon.noname-b con 0x7f904408ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904412ba30 con 0x7f904408d8d0 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9044128a30 con 0x7f904408ddb0 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904405e1b0 con 0x7f904408d4d0 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient(hunting): authenticate will time out at 1039.005290s 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9048813640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f904408d8d0 0x7f9044128320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33040/0 (socket says 10.20.193.43:33040) 2026-02-21T01:35:07.316 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9049014640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f904408d4d0 0x7f9044127c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58284/0 (socket says 10.20.193.43:58284) 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9048813640 1 -- 10.20.193.43:0/133290162 learned_addr learned my addr 10.20.193.43:0/133290162 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 client.?.objecter ms_handle_connect 0x7f904408d8d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 client.?.objecter ms_handle_connect 0x7f904408d4d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786600304 0 0) 0x7f904412ba30 con 0x7f904408d8d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): my global_id is 25149 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9014003610 con 0x7f904408d8d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096693196 0 0) 0x7f904405e1b0 con 0x7f904408d4d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): my global_id is 104105 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f904412ba30 con 0x7f904408d4d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3017338376 0 0) 0x7f9014003610 con 0x7f904408d8d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f904405e1b0 con 0x7f904408d8d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f90380030f0 con 0x7f904408d8d0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.317 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): dump: 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2376249854 0 0) 0x7f904412ba30 con 0x7f904408d4d0 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9014003610 con 0x7f904408d4d0 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 client.?.objecter ms_handle_connect 0x7f904408ddb0 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9034002fd0 con 0x7f904408d4d0 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient(hunting): dump: 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.318 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1668905624 0 0) 0x7f904405e1b0 con 0x7f904408d8d0 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.43:6790/0 conn(0x7f904408d4d0 legacy=0x7f9044127c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.46:6789/0 conn(0x7f904408ddb0 legacy=0x7f904418ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 monclient: found mon.a 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904413a4e0 con 0x7f904408d8d0 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 5 monclient: authenticate success, global_id 25149 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient: _renew_subs 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f904412abc0 con 0x7f904408d8d0 2026-02-21T01:35:07.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 client.25149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient: _renew_subs 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9044129720 con 0x7f904408d8d0 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f904b29f640 1 librados: init done 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9038003520 con 0x7f904408d8d0 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9038003b50 con 0x7f904408d8d0 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f90337fe640 4 set_mon_vals no callback set 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.299+0000 7f9031ffb640 10 monclient: dump: 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f904b29f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f904408ed90 con 0x7f90441a10d0 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 client.25149.objecter ms_handle_connect 0x7f90441a10d0 2026-02-21T01:35:07.320 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 client.25149.objecter resend_mon_ops 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528015099 0 0) 0x7f904408ed90 con 0x7f90441a10d0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient(hunting): my global_id is 104108 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f904405e1b0 con 0x7f90441a10d0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f9038003d70 con 0x7f904408d8d0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3885403633 0 0) 0x7f904405e1b0 con 0x7f90441a10d0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f904408ed90 con 0x7f90441a10d0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f903804e0a0 con 0x7f904408d8d0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 client.25149.objecter ms_dispatch2 0x7f9044000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 3 client.25149.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 3 client.25149.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 20 client.25149.objecter dump_active .. 0 homeless 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f9034003b50 con 0x7f90441a10d0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient: dump: 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.321 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2773014118 0 0) 0x7f904408ed90 con 0x7f90441a10d0 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90440008d0 con 0x7f90441a10d0 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9049815640 10 monclient: get_auth_request con 0x7f901403e960 auth_method 0 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 client.25149.objecter ms_handle_connect 0x7f901403e960 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f90340039d0 con 0x7f90441a10d0 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.43:6790/0 conn(0x7f90441a10d0 legacy=0x7f904405a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.300+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.43:6790/0 conn(0x7f90441a10d0 legacy=0x7f904405a7b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f904404d140 con 0x7f904412a350 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 client.25149.objecter ms_handle_connect 0x7f904412a350 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 client.25149.objecter resend_mon_ops 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599050087 0 0) 0x7f904404d140 con 0x7f904412a350 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient(hunting): my global_id is 104111 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f904408ed90 con 0x7f904412a350 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4101156309 0 0) 0x7f904408ed90 con 0x7f904412a350 2026-02-21T01:35:07.322 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f904404d140 con 0x7f904412a350 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f90340042e0 con 0x7f904412a350 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient: dump: 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2679993332 0 0) 0x7f904404d140 con 0x7f904412a350 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 --> v1:10.20.193.43:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f90441922d0 con 0x7f904412a350 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 <== mon.2 v1:10.20.193.43:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4146 (unknown 0 0 3463658386) 0x7f9034004100 con 0x7f904412a350 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.43:6790/0 conn(0x7f904412a350 legacy=0x7f904404ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.323 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9031ffb640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.43:6790/0 conn(0x7f904412a350 legacy=0x7f904404ca30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 32, 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 364, 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.324 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:35:07.325 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.326 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.327 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.328 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:35:07.329 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 10 librados: watch_flush enter 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 10 librados: watch_flush exit 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 20 client.25149.objecter shutdown clearing up homeless session... 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 10 client.25149.objecter successfully canceled tick 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.46:6812/860801619 conn(0x7f901403e960 legacy=0x7f901405ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 10 monclient: shutdown 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 >> v1:10.20.193.43:6789/0 conn(0x7f904408d8d0 legacy=0x7f9044128320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f9049815640 1 -- 10.20.193.43:0/133290162 reap_dead start 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.304+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 shutdown_connections 2026-02-21T01:35:07.330 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.305+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 >> 10.20.193.43:0/133290162 conn(0x7f904408f480 msgr2=0x7f90441a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.331 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.305+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 shutdown_connections 2026-02-21T01:35:07.331 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.305+0000 7f904b29f640 1 -- 10.20.193.43:0/133290162 wait complete. 2026-02-21T01:35:07.331 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.305+0000 7f904b29f640 1 librados: shutdown 2026-02-21T01:35:07.331 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:35:07.331 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-21T01:35:07.331 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient: get_monmap_and_config 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient: monmap: 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:07.400381+0000 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:07.400381+0000 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.408 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 1 Processor -- start 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 1 -- start start 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient: init 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient(hunting): picked mon.noname-c con 0x7f56a408ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient(hunting): picked mon.noname-b con 0x7f56a408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient(hunting): picked mon.noname-a con 0x7f56a408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a408a690 con 0x7f56a408d8d0 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a408b910 con 0x7f56a408ddb0 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a4088ae0 con 0x7f56a408d4d0 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56ab05c640 10 monclient(hunting): authenticate will time out at 1039.105818s 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f569bfff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f56a408d4d0 0x7f56a417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58314/0 (socket says 10.20.193.43:58314) 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f569bfff640 1 -- 10.20.193.43:0/1611076603 learned_addr learned my addr 10.20.193.43:0/1611076603 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.399+0000 7f56a95d2640 1 --1- 10.20.193.43:0/1611076603 >> v1:10.20.193.43:6789/0 conn(0x7f56a408d8d0 0x7f56a419f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33052/0 (socket says 10.20.193.43:33052) 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182401594 0 0) 0x7f56a4088ae0 con 0x7f56a408d4d0 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): my global_id is 104114 2026-02-21T01:35:07.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5690003610 con 0x7f56a408d4d0 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019571433 0 0) 0x7f56a408a690 con 0x7f56a408d8d0 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient(hunting): my global_id is 25152 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a4088ae0 con 0x7f56a408d8d0 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 112217977 0 0) 0x7f56a4088ae0 con 0x7f56a408d8d0 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 >> v1:10.20.193.43:6790/0 conn(0x7f56a408d4d0 legacy=0x7f56a417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 >> v1:10.20.193.46:6789/0 conn(0x7f56a408ddb0 legacy=0x7f56a408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 monclient: found mon.noname-a 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a41a3ef0 con 0x7f56a408d8d0 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f56a0003170 con 0x7f56a408d8d0 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: dump: 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.412 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 5 monclient: authenticate success, global_id 25152 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56a00033b0 con 0x7f56a408d8d0 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 1 -- 10.20.193.43:0/1611076603 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f56a00037f0 con 0x7f56a408d8d0 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f569b7fe640 10 monclient: dump: 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.413 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 4 set_mon_vals no callback set 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 10 monclient: shutdown 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 1 -- 10.20.193.43:0/1611076603 >> v1:10.20.193.43:6789/0 conn(0x7f56a408d8d0 legacy=0x7f56a419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 1 -- 10.20.193.43:0/1611076603 shutdown_connections 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 1 -- 10.20.193.43:0/1611076603 >> 10.20.193.43:0/1611076603 conn(0x7f56a408f480 msgr2=0x7f56a408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 1 -- 10.20.193.43:0/1611076603 shutdown_connections 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 1 -- 10.20.193.43:0/1611076603 wait complete. 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.400+0000 7f56ab05c640 10 monclient: monmap: 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 librados: starting msgr at 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 librados: starting objecter 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 Processor -- start 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 -- start start 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 librados: setting wanted keys 2026-02-21T01:35:07.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 librados: calling monclient init 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient: init 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient(hunting): picked mon.noname-c con 0x7f56a408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient(hunting): picked mon.noname-b con 0x7f56a408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient(hunting): picked mon.noname-a con 0x7f56a408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a4128d30 con 0x7f56a408ddb0 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a4129010 con 0x7f56a408d8d0 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a405e1b0 con 0x7f56a408d4d0 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient(hunting): authenticate will time out at 1039.107391s 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56a8dd1640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f56a408d4d0 0x7f56a41254b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58316/0 (socket says 10.20.193.43:58316) 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56a95d2640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f56a408ddb0 0x7f56a419b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33062/0 (socket says 10.20.193.43:33062) 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56a8dd1640 1 -- 10.20.193.43:0/2484773238 learned_addr learned my addr 10.20.193.43:0/2484773238 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 client.?.objecter ms_handle_connect 0x7f56a408ddb0 2026-02-21T01:35:07.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 client.?.objecter ms_handle_connect 0x7f56a408d4d0 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259783650 0 0) 0x7f56a4128d30 con 0x7f56a408ddb0 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): my global_id is 25155 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5674003610 con 0x7f56a408ddb0 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1610466182 0 0) 0x7f56a405e1b0 con 0x7f56a408d4d0 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): my global_id is 104117 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a4128d30 con 0x7f56a408d4d0 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3996976301 0 0) 0x7f56a4128d30 con 0x7f56a408d4d0 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56a405e1b0 con 0x7f56a408d4d0 2026-02-21T01:35:07.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2328959872 0 0) 0x7f5674003610 con 0x7f56a408ddb0 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56a4128d30 con 0x7f56a408ddb0 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5694003190 con 0x7f56a408d4d0 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): dump: 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f56a0003560 con 0x7f56a408ddb0 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient(hunting): dump: 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 client.?.objecter ms_handle_connect 0x7f56a408d8d0 2026-02-21T01:35:07.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3406517279 0 0) 0x7f56a405e1b0 con 0x7f56a408d4d0 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.46:6789/0 conn(0x7f56a408d8d0 legacy=0x7f56a4125bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.43:6789/0 conn(0x7f56a408ddb0 legacy=0x7f56a419b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 monclient: found mon.c 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a413a5f0 con 0x7f56a408d4d0 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 5 monclient: authenticate success, global_id 104117 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient: _renew_subs 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56a4126cb0 con 0x7f56a408d4d0 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 client.104117.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient: _renew_subs 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f56a41262d0 con 0x7f56a408d4d0 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56ab05c640 1 librados: init done 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5694003330 con 0x7f56a408d4d0 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5694003b50 con 0x7f56a408d4d0 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f56997fa640 10 monclient: dump: 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.421 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.401+0000 7f569affd640 4 set_mon_vals no callback set 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56ab05c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56a4089f00 con 0x7f56a41a10d0 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f5694003cf0 con 0x7f56a408d4d0 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f569404e140 con 0x7f56a408d4d0 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 client.104117.objecter ms_dispatch2 0x7f56a4000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 3 client.104117.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 3 client.104117.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:07.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 20 client.104117.objecter dump_active .. 0 homeless 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 client.104117.objecter ms_handle_connect 0x7f56a41a10d0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 client.104117.objecter resend_mon_ops 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56a95d2640 10 monclient: get_auth_request con 0x7f567403e9a0 auth_method 0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514261251 0 0) 0x7f56a4129010 con 0x7f56a41a10d0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 monclient(hunting): my global_id is 84367 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a405e1b0 con 0x7f56a41a10d0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 318146988 0 0) 0x7f56a405e1b0 con 0x7f56a41a10d0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56a4129010 con 0x7f56a41a10d0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 client.104117.objecter ms_handle_connect 0x7f567403e9a0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f568c002980 con 0x7f56a41a10d0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.402+0000 7f56997fa640 10 monclient: dump: 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.423 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.403+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2644389072 0 0) 0x7f56a4129010 con 0x7f56a41a10d0 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.403+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56a4128770 con 0x7f56a41a10d0 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.403+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f568c0028e0 con 0x7f56a41a10d0 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.403+0000 7f56997fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.403+0000 7f56997fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.403+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.46:6789/0 conn(0x7f56a41a10d0 legacy=0x7f56a40876e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.424 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.403+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.46:6789/0 conn(0x7f56a41a10d0 legacy=0x7f56a40876e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56ab05c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56a408ed90 con 0x7f56a404ca30 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 client.104117.objecter ms_handle_connect 0x7f56a404ca30 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 client.104117.objecter resend_mon_ops 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577434144 0 0) 0x7f56a408ed90 con 0x7f56a404ca30 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 monclient(hunting): my global_id is 84370 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a4129010 con 0x7f56a404ca30 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3240535703 0 0) 0x7f56a4129010 con 0x7f56a404ca30 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56a408ed90 con 0x7f56a404ca30 2026-02-21T01:35:07.426 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f568c0048d0 con 0x7f56a404ca30 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 10 monclient: dump: 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1212357450 0 0) 0x7f56a408ed90 con 0x7f56a404ca30 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.407+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 --> v1:10.20.193.46:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f56a4054ff0 con 0x7f56a404ca30 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 <== mon.1 v1:10.20.193.46:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4483 (unknown 0 0 1586590546) 0x7f568c0048d0 con 0x7f56a404ca30 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56997fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-21T01:35:07.427 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56997fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.46:6789/0 conn(0x7f56a404ca30 legacy=0x7f56a412d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56997fa640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.46:6789/0 conn(0x7f56a404ca30 legacy=0x7f56a412d570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: "state": "peon", 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: "election_epoch": 32, 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: "uptime": 214426, 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: "quorum": [ 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: 0, 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: 1, 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: 2 2026-02-21T01:35:07.428 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_age": 0, 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "required_con": "2453899407728394244", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "required_mon": [ 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.429 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_con": "4544132024016699391", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "quorum_mon": [ 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.430 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "outside_quorum": [], 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "extra_probe_peers": [], 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "sync_provider": [], 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "monmap": { 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "epoch": 1, 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "fsid": "6ad0f5d2-7471-410a-a664-22f2b680bffe", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "modified": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "created": "2026-02-21T01:27:33.280306Z", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release": 20, 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "min_mon_release_name": "tentacle", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "election_strategy": 1, 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "disallowed_leaders": "", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false, 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "tiebreaker_mon": "", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "removed_ranks": "", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "features": { 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "persistent": [ 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "kraken", 2026-02-21T01:35:07.431 INFO:teuthology.orchestra.run.trial043.stdout: "luminous", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "mimic", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "osdmap-prune", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "nautilus", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "octopus", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "pacific", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "elector-pinging", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "quincy", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "reef", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "squid", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "tentacle", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "nvmeof_beacon_diff" 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "optional": [] 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "mons": [ 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 0, 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "name": "a", 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.432 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789", 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6789/0", 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6789/0", 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 1, 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "name": "b", 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789", 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.433 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.46:6789/0", 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.46:6789/0", 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "rank": 2, 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "name": "c", 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "public_addrs": { 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "addrvec": [ 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "type": "v1", 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790", 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "nonce": 0 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "addr": "10.20.193.43:6790/0", 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "public_addr": "10.20.193.43:6790/0", 2026-02-21T01:35:07.434 INFO:teuthology.orchestra.run.trial043.stdout: "priority": 0, 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "weight": 0, 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "crush_location": "{}" 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "feature_map": { 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "mon": [ 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "osd": [ 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "num": 3 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "client": [ 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.435 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: "num": 2 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: ], 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: "mgr": [ 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: { 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: "features": "0x3f0ffffffffdffff", 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: "release": "squid", 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: "num": 1 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: } 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: ] 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: }, 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout: "stretch_mode": false 2026-02-21T01:35:07.436 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:07.437 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 10 librados: watch_flush enter 2026-02-21T01:35:07.437 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 10 librados: watch_flush exit 2026-02-21T01:35:07.437 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 20 client.104117.objecter shutdown clearing up homeless session... 2026-02-21T01:35:07.437 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 10 client.104117.objecter successfully canceled tick 2026-02-21T01:35:07.437 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.46:6812/860801619 conn(0x7f567403e9a0 legacy=0x7f567405ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 10 monclient: shutdown 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 >> v1:10.20.193.43:6790/0 conn(0x7f56a408d4d0 legacy=0x7f56a41254b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56a95d2640 1 -- 10.20.193.43:0/2484773238 reap_dead start 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56a95d2640 1 -- 10.20.193.43:0/2484773238 reap_dead start 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 shutdown_connections 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 >> 10.20.193.43:0/2484773238 conn(0x7f56a408f480 msgr2=0x7f56a4120c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 shutdown_connections 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 1 -- 10.20.193.43:0/2484773238 wait complete. 2026-02-21T01:35:07.438 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.408+0000 7f56ab05c640 1 librados: shutdown 2026-02-21T01:35:07.438 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-21T01:35:07.439 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-21T01:35:07.439 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.507+0000 7ff47e482640 10 monclient: get_monmap_and_config 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.507+0000 7ff47e482640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.507+0000 7ff47e482640 10 monclient: monmap: 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:07.508869+0000 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:07.508869+0000 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:07.509 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.507+0000 7ff47e482640 1 Processor -- start 2026-02-21T01:35:07.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.507+0000 7ff47e482640 1 -- start start 2026-02-21T01:35:07.510 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.507+0000 7ff47e482640 10 monclient: init 2026-02-21T01:35:07.514 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.514 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:07.514 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient(hunting): picked mon.noname-b con 0x7ff47808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient(hunting): picked mon.noname-a con 0x7ff47808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient(hunting): picked mon.noname-c con 0x7ff47808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff47808a690 con 0x7ff47808d4d0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff47808b910 con 0x7ff47808d8d0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff478088ae0 con 0x7ff47808ddb0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient(hunting): authenticate will time out at 1039.214306s 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff477fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff47808ddb0 0x7ff47808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58324/0 (socket says 10.20.193.43:58324) 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff4777fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff47808d4d0 0x7ff47817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33074/0 (socket says 10.20.193.43:33074) 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff477fff640 1 -- 10.20.193.43:0/2863429483 learned_addr learned my addr 10.20.193.43:0/2863429483 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354102643 0 0) 0x7ff478088ae0 con 0x7ff47808ddb0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): my global_id is 104120 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff45c003610 con 0x7ff47808ddb0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195085271 0 0) 0x7ff47808a690 con 0x7ff47808d4d0 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.515 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient(hunting): my global_id is 25158 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff478088ae0 con 0x7ff47808d4d0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4176725805 0 0) 0x7ff478088ae0 con 0x7ff47808d4d0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 >> v1:10.20.193.43:6790/0 conn(0x7ff47808ddb0 legacy=0x7ff47808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 >> v1:10.20.193.46:6789/0 conn(0x7ff47808d8d0 legacy=0x7ff47819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 monclient: found mon.noname-a 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4781a3ef0 con 0x7ff47808d4d0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff468002df0 con 0x7ff47808d4d0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: dump: 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.516 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 5 monclient: authenticate success, global_id 25158 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff468003030 con 0x7ff47808d4d0 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 1 -- 10.20.193.43:0/2863429483 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff468003470 con 0x7ff47808d4d0 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 4 set_mon_vals no callback set 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff476ffd640 10 monclient: dump: 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.517 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 10 monclient: shutdown 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.508+0000 7ff47e482640 1 -- 10.20.193.43:0/2863429483 >> v1:10.20.193.43:6789/0 conn(0x7ff47808d4d0 legacy=0x7ff47817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- 10.20.193.43:0/2863429483 shutdown_connections 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- 10.20.193.43:0/2863429483 >> 10.20.193.43:0/2863429483 conn(0x7ff47808f480 msgr2=0x7ff47808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- 10.20.193.43:0/2863429483 shutdown_connections 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- 10.20.193.43:0/2863429483 wait complete. 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient: build_initial_monmap 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient: monmap: 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:07.518 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 librados: starting msgr at 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 librados: starting objecter 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 Processor -- start 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- start start 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 librados: setting wanted keys 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 librados: calling monclient init 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient: init 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient(hunting): picked mon.noname-c con 0x7ff47808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient(hunting): picked mon.noname-b con 0x7ff47808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient(hunting): picked mon.noname-a con 0x7ff47808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff478088000 con 0x7ff47808ddb0 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff47812db20 con 0x7ff47808d8d0 2026-02-21T01:35:07.519 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff478087380 con 0x7ff47808d4d0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff47e482640 10 monclient(hunting): authenticate will time out at 1039.215852s 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff477fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff47808d4d0 0x7ff478086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58334/0 (socket says 10.20.193.43:58334) 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff477fff640 1 -- 10.20.193.43:0/3904461260 learned_addr learned my addr 10.20.193.43:0/3904461260 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 10 client.?.objecter ms_handle_connect 0x7ff47808d4d0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 10 client.?.objecter ms_handle_connect 0x7ff47808ddb0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224369806 0 0) 0x7ff478088000 con 0x7ff47808ddb0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.509+0000 7ff474ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): my global_id is 25161 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff448003610 con 0x7ff47808ddb0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997111998 0 0) 0x7ff478087380 con 0x7ff47808d4d0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): my global_id is 104123 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff478088000 con 0x7ff47808d4d0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 client.?.objecter ms_handle_connect 0x7ff47808d8d0 2026-02-21T01:35:07.520 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3888223641 0 0) 0x7ff448003610 con 0x7ff47808ddb0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff478087380 con 0x7ff47808ddb0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff46c003040 con 0x7ff47808ddb0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3207643443 0 0) 0x7ff478088000 con 0x7ff47808d4d0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff448003610 con 0x7ff47808d4d0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398844388 0 0) 0x7ff47812db20 con 0x7ff47808d8d0 2026-02-21T01:35:07.521 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): my global_id is 84373 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff478088000 con 0x7ff47808d8d0 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff464003020 con 0x7ff47808d4d0 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1055066829 0 0) 0x7ff478087380 con 0x7ff47808ddb0 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 >> v1:10.20.193.43:6790/0 conn(0x7ff47808d4d0 legacy=0x7ff478086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 >> v1:10.20.193.46:6789/0 conn(0x7ff47808d8d0 legacy=0x7ff478086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.522 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 monclient: found mon.a 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47808c6d0 con 0x7ff47808ddb0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: _finish_auth 0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 5 monclient: authenticate success, global_id 25161 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 monclient: _renew_subs 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff47813a5d0 con 0x7ff47808ddb0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 client.25161.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 monclient: _renew_subs 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff47805e190 con 0x7ff47808ddb0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 1 librados: init done 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff46c003740 con 0x7ff47808ddb0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff46c003e50 con 0x7ff47808ddb0 2026-02-21T01:35:07.523 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 10 monclient: dump: 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff4767fc640 4 set_mon_vals no callback set 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47808ed90 con 0x7ff47808ddb0 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.510+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff46c0107d0 con 0x7ff47808ddb0 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.511+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7ff46c04d100 con 0x7ff47808ddb0 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.511+0000 7ff474ff9640 10 client.25161.objecter ms_dispatch2 0x7ff478000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:07.524 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.511+0000 7ff474ff9640 3 client.25161.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:07.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.511+0000 7ff474ff9640 3 client.25161.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:07.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.511+0000 7ff474ff9640 20 client.25161.objecter dump_active .. 0 homeless 2026-02-21T01:35:07.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.511+0000 7ff477fff640 10 monclient: get_auth_request con 0x7ff44803eba0 auth_method 0 2026-02-21T01:35:07.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.511+0000 7ff474ff9640 10 client.25161.objecter ms_handle_connect 0x7ff44803eba0 2026-02-21T01:35:07.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.513+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff46c016840 con 0x7ff47808ddb0 2026-02-21T01:35:07.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.513+0000 7ff474ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:07.525 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.513+0000 7ff474ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:07.667 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.665+0000 7ff47e482640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-21T01:35:07.667 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.665+0000 7ff47e482640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-21T01:35:07.667 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.665+0000 7ff47e482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:07.667 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.665+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff47812d280 con 0x7ff47808ddb0 2026-02-21T01:35:07.668 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.666+0000 7ff474ff9640 1 -- 10.20.193.43:0/3904461260 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7ff46c016140 con 0x7ff47808ddb0 2026-02-21T01:35:07.668 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.666+0000 7ff474ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-21T01:35:07.668 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.666+0000 7ff474ff9640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=2211626973,config=3140514009,health=3767522241,kv=1200173230,logm=772137065}) 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=1449564197,config=3140514009,health=2969413476,kv=1200173230,logm=2187159492}) 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=2211626973,config=3140514009,health=3767522241,kv=1200173230,logm=772137065}) 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=2083355627,config=3140514009,health=467750611,kv=3045408080,logm=1951907856}) 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3293249879}) 2026-02-21T01:35:07.669 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=727315931}) 2026-02-21T01:35:07.670 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.670 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3293249879}) 2026-02-21T01:35:07.670 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.666+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1277791404}) 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.666+0000 7ff47e482640 10 librados: watch_flush enter 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 10 librados: watch_flush exit 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 20 client.25161.objecter shutdown clearing up homeless session... 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 10 client.25161.objecter successfully canceled tick 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 >> v1:10.20.193.46:6812/860801619 conn(0x7ff44803eba0 legacy=0x7ff44805f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 10 monclient: shutdown 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:07.671 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 >> v1:10.20.193.43:6789/0 conn(0x7ff47808ddb0 legacy=0x7ff47818ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:07.672 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 shutdown_connections 2026-02-21T01:35:07.672 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 >> 10.20.193.43:0/3904461260 conn(0x7ff47808f480 msgr2=0x7ff4781a3090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:07.672 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 shutdown_connections 2026-02-21T01:35:07.672 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 1 -- 10.20.193.43:0/3904461260 wait complete. 2026-02-21T01:35:07.672 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:07.667+0000 7ff47e482640 1 librados: shutdown 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331673911}) 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1191183271}) 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331673911}) 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=67541549}) 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.680 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3345530450}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2099272376}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3345530450}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.667+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1079051975}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573820327}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=562156752}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573820327}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2998434237}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1889827488}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3911011728}) 2026-02-21T01:35:07.681 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1889827488}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1972671114}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3471437781}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1032431934}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3471437781}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.668+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3103653542}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2303474776}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=181598105}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2303474776}) 2026-02-21T01:35:07.682 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1732994529}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3709128310}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=429988474}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3709128310}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3910186482}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772776417}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3111956638}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772776417}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.669+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=318540297}) 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.683 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1406756976}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2620974966}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1406756976}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=545672588}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581057186}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2253475136}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581057186}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1017994742}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118144233}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2433830833}) 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.684 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2118144233}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.670+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3358522315}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3381409329}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2061811778}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3381409329}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2998285234}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898251293}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3712425147}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898251293}) 2026-02-21T01:35:07.685 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=604006567}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3328325445}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=310988950}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3328325445}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.671+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1093612970}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=555356045}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=485710873}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=555356045}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3804473768}) 2026-02-21T01:35:07.686 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2876548408}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=838136157}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2876548408}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3318797326}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2249128383}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3181107707}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2249128383}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.672+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3968991905}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477610071}) 2026-02-21T01:35:07.687 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=816146544}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2477610071}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=399781467}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671105572}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=500530438}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671105572}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3877478652}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=216390588}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=78272337}) 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.688 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=216390588}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.673+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=146636460}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669845806}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3068601792}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669845806}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2883798141}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=311326601}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2248666535}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=311326601}) 2026-02-21T01:35:07.689 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2190448280}) 2026-02-21T01:35:07.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-21T01:35:07.696 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1414641989}) 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4160686174}) 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1414641989}) 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.674+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=619112546}) 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=991186298}) 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4237530675}) 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=991186298}) 2026-02-21T01:35:07.697 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1310596687}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264824852}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1292800379}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264824852}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3061984669}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432488053}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4182315336}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432488053}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2899501286}) 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.698 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467868730}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1332659563}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467868730}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.675+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1421033859}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711761542}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1456035608}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711761542}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1973080542}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4263884976}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=873730641}) 2026-02-21T01:35:07.699 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4263884976}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.676+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2823794199}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=85,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=2} crc {logm=230212167,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=823618227}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=85,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=3} crc {logm=4120423610,mdsmap=3068764153,mgr=278247660,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=3490809408}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=85,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=2} crc {logm=230212167,mdsmap=3068764153,mgr=2204815247,mgr_command_descs=1355769440,mgr_metadata=883221767,mgrstat=823618227}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=4218795825,mdsmap=3068764153,mgr=1073115256}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=17,osdmap=56} crc {mgrstat=3824482101,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2763296526,osd_pg_creating=3087458558,osd_snap=2773947909,osdmap=836348174}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=18,osdmap=52} crc {mgrstat=744586161,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=3087458558,osd_snap=3709060478,osdmap=2990942624}) 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.700 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=8,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=17,osdmap=56} crc {mgrstat=3824482101,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2763296526,osd_pg_creating=3087458558,osd_snap=2773947909,osdmap=836348174}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=18,osdmap=53} crc {mgrstat=587536491,mon_config_key=3899043079,monmap=4257464702,nvmeofgw=3360707892,osd_metadata=2108339561,osd_pg_creating=3087458558,osd_snap=3709060478,osdmap=3708261778}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=408597788}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2621920758}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=408597788}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.677+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=85521579}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1713288681}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3989941410}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1713288681}) 2026-02-21T01:35:07.701 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2408172779}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2635195847}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=102190155}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2635195847}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.678+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3025439957}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1886559341}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1638962143}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1886559341}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3364451926}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=17} crc {osdmap=584364148}) 2026-02-21T01:35:07.702 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=16} crc {osdmap=441698160}) 2026-02-21T01:35:07.703 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-21T01:35:07.703 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=17} crc {osdmap=584364148}) 2026-02-21T01:35:07.703 INFO:tasks.ceph.mon.a.trial043.stderr:2026-02-21T01:35:07.679+0000 7f79cbb00640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=17} crc {osdmap=3178273573}) 2026-02-21T01:35:08.692 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-21T01:35:08.692 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-21T01:35:08.768 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.759+0000 7f236fad1640 10 monclient: get_monmap_and_config 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.759+0000 7f236fad1640 10 monclient: build_initial_monmap 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.759+0000 7f236fad1640 10 monclient: monmap: 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:08.761007+0000 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:08.761007+0000 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:08.769 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 1 Processor -- start 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 1 -- start start 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient: init 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient(hunting): picked mon.noname-c con 0x7f236808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient(hunting): picked mon.noname-a con 0x7f236808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient(hunting): picked mon.noname-b con 0x7f236808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:08.770 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236808a690 con 0x7f236808d4d0 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236808b910 con 0x7f236808ddb0 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2368088ae0 con 0x7f236808d8d0 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient(hunting): authenticate will time out at 1040.466452s 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236d045640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f236808d4d0 0x7f236817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33078/0 (socket says 10.20.193.43:33078) 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236e047640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f236808d8d0 0x7f236819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58336/0 (socket says 10.20.193.43:58336) 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236d045640 1 -- 10.20.193.43:0/613680579 learned_addr learned my addr 10.20.193.43:0/613680579 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341810974 0 0) 0x7f2368088ae0 con 0x7f236808d8d0 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): _negotiate 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:08.771 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): my global_id is 104126 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2350003610 con 0x7f236808d8d0 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422691704 0 0) 0x7f236808a690 con 0x7f236808d4d0 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): _negotiate 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient(hunting): my global_id is 25164 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2368088ae0 con 0x7f236808d4d0 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3048179396 0 0) 0x7f2350003610 con 0x7f236808d8d0 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 >> v1:10.20.193.46:6789/0 conn(0x7f236808ddb0 legacy=0x7f236808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:35:08.772 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 >> v1:10.20.193.43:6789/0 conn(0x7f236808d4d0 legacy=0x7f236817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: _finish_hunting 0 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 monclient: found mon.noname-b 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23681a3ef0 con 0x7f236808d8d0 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: _finish_auth 0 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: _check_auth_tickets 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2364003170 con 0x7f236808d8d0 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: dump: 2026-02-21T01:35:08.773 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 5 monclient: authenticate success, global_id 104126 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:08.774 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2364003430 con 0x7f236808d8d0 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 1 -- 10.20.193.43:0/613680579 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2364003870 con 0x7f236808d8d0 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236fad1640 4 set_mon_vals no callback set 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.760+0000 7f236c844640 10 monclient: dump: 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.775 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 10 monclient: shutdown 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 -- 10.20.193.43:0/613680579 >> v1:10.20.193.43:6790/0 conn(0x7f236808d8d0 legacy=0x7f236819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 -- 10.20.193.43:0/613680579 shutdown_connections 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 -- 10.20.193.43:0/613680579 >> 10.20.193.43:0/613680579 conn(0x7f236808f480 msgr2=0x7f236808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:08.776 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 -- 10.20.193.43:0/613680579 shutdown_connections 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 -- 10.20.193.43:0/613680579 wait complete. 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 10 monclient: build_initial_monmap 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 10 monclient: monmap: 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:08.777 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 librados: starting msgr at 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 librados: starting objecter 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.761+0000 7f236fad1640 1 Processor -- start 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 -- start start 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 librados: setting wanted keys 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 librados: calling monclient init 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient: init 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient(hunting): picked mon.noname-a con 0x7f236808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:08.778 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient(hunting): picked mon.noname-c con 0x7f236808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient(hunting): picked mon.noname-b con 0x7f236808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2368128e30 con 0x7f236808d4d0 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236808c7a0 con 0x7f236808ddb0 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2368127910 con 0x7f236808d8d0 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient(hunting): authenticate will time out at 1040.468260s 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236d846640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f236808d4d0 0x7f2368086590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33090/0 (socket says 10.20.193.43:33090) 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236d846640 1 -- 10.20.193.43:0/233901556 learned_addr learned my addr 10.20.193.43:0/233901556 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 client.?.objecter ms_handle_connect 0x7f236808d8d0 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 client.?.objecter ms_handle_connect 0x7f236808d4d0 2026-02-21T01:35:08.779 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559459201 0 0) 0x7f2368127910 con 0x7f236808d8d0 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): my global_id is 104129 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2338003610 con 0x7f236808d8d0 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627533985 0 0) 0x7f2368128e30 con 0x7f236808d4d0 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): my global_id is 25167 2026-02-21T01:35:08.780 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2368127910 con 0x7f236808d4d0 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 524470288 0 0) 0x7f2338003610 con 0x7f236808d8d0 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2368128e30 con 0x7f236808d8d0 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 client.?.objecter ms_handle_connect 0x7f236808ddb0 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f235c0030f0 con 0x7f236808d8d0 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): dump: 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.781 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4281257951 0 0) 0x7f2368127910 con 0x7f236808d4d0 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2338003610 con 0x7f236808d4d0 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f23580040d0 con 0x7f236808d4d0 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:08.782 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient(hunting): dump: 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:08.783 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1805993193 0 0) 0x7f2368128e30 con 0x7f236808d8d0 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 >> v1:10.20.193.46:6789/0 conn(0x7f236808ddb0 legacy=0x7f23680873b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 >> v1:10.20.193.43:6789/0 conn(0x7f236808d4d0 legacy=0x7f2368086590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: _finish_hunting 0 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 monclient: found mon.c 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2368128b50 con 0x7f236808d8d0 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: _finish_auth 0 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: _check_auth_tickets 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 5 monclient: authenticate success, global_id 104129 2026-02-21T01:35:08.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient: _renew_subs 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f236813a130 con 0x7f236808d8d0 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 client.104129.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient: _renew_subs 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f236819caf0 con 0x7f236808d8d0 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f236fad1640 1 librados: init done 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f235c003460 con 0x7f236808d8d0 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f235c004d20 con 0x7f236808d8d0 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:08.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f23567fc640 10 monclient: dump: 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:08.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.762+0000 7f2357fff640 4 set_mon_vals no callback set 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f236fad1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f236fad1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f236fad1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236805e190 con 0x7f236808d8d0 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f235c0116a0 con 0x7f236808d8d0 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f235c04df90 con 0x7f236808d8d0 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f23567fc640 10 client.104129.objecter ms_dispatch2 0x7f2368000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f23567fc640 3 client.104129.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f23567fc640 3 client.104129.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f23567fc640 20 client.104129.objecter dump_active .. 0 homeless 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f236d846640 10 monclient: get_auth_request con 0x7f233803e950 auth_method 0 2026-02-21T01:35:08.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.763+0000 7f23567fc640 10 client.104129.objecter ms_handle_connect 0x7f233803e950 2026-02-21T01:35:08.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.765+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f235c017630 con 0x7f236808d8d0 2026-02-21T01:35:08.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.765+0000 7f23567fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:08.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.765+0000 7f23567fc640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:08.917 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.915+0000 7f236fad1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-21T01:35:08.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.915+0000 7f236fad1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-21T01:35:08.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.915+0000 7f236fad1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:08.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.915+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f236808edd0 con 0x7f236808d8d0 2026-02-21T01:35:08.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.915+0000 7f23567fc640 1 -- 10.20.193.43:0/233901556 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1466 (unknown 254746657 0 549507092) 0x7f235c01c610 con 0x7f236808d8d0 2026-02-21T01:35:08.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.915+0000 7f23567fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-21T01:35:08.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.915+0000 7f23567fc640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:08.918 INFO:teuthology.orchestra.run.trial043.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","modified":"2026-02-21T01:27:33.280306Z","created":"2026-02-21T01:27:33.280306Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6789","nonce":0}]},"addr":"10.20.193.43:6789/0","public_addr":"10.20.193.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6789","nonce":0}]},"addr":"10.20.193.46:6789/0","public_addr":"10.20.193.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6790","nonce":0}]},"addr":"10.20.193.43:6790/0","public_addr":"10.20.193.43:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 10 librados: watch_flush enter 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 10 librados: watch_flush exit 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 20 client.104129.objecter shutdown clearing up homeless session... 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 10 client.104129.objecter successfully canceled tick 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 >> v1:10.20.193.46:6812/860801619 conn(0x7f233803e950 legacy=0x7f233805ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 10 monclient: shutdown 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:08.920 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 >> v1:10.20.193.43:6790/0 conn(0x7f236808d8d0 legacy=0x7f2368086ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:08.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 shutdown_connections 2026-02-21T01:35:08.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 >> 10.20.193.43:0/233901556 conn(0x7f236808f480 msgr2=0x7f23680581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:08.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 shutdown_connections 2026-02-21T01:35:08.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 1 -- 10.20.193.43:0/233901556 wait complete. 2026-02-21T01:35:08.921 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:08.917+0000 7f236fad1640 1 librados: shutdown 2026-02-21T01:35:08.926 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-21T01:35:08.926 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-21T01:35:08.940 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-21T01:35:08.940 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.005+0000 7f5b12e13640 10 monclient: get_monmap_and_config 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.005+0000 7f5b12e13640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.005+0000 7f5b12e13640 10 monclient: monmap: 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:09.007262+0000 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:09.007262+0000 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.018 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 1 Processor -- start 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 1 -- start start 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient: init 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient(hunting): picked mon.noname-a con 0x7f5b0c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient(hunting): picked mon.noname-b con 0x7f5b0c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient(hunting): picked mon.noname-c con 0x7f5b0c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c08a690 con 0x7f5b0c08ddb0 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c08b910 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c088ae0 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.019 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b12e13640 10 monclient(hunting): authenticate will time out at 1040.712629s 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b10b88640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f5b0c08ddb0 0x7f5b0c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33092/0 (socket says 10.20.193.43:33092) 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b03fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f5b0c08d4d0 0x7f5b0c17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58358/0 (socket says 10.20.193.43:58358) 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b10b88640 1 -- 10.20.193.43:0/1015590144 learned_addr learned my addr 10.20.193.43:0/1015590144 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505917552 0 0) 0x7f5b0c088ae0 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): my global_id is 104132 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af8003610 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482798154 0 0) 0x7f5b0c08a690 con 0x7f5b0c08ddb0 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 10 monclient(hunting): my global_id is 25170 2026-02-21T01:35:09.020 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.006+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b0c088ae0 con 0x7f5b0c08ddb0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1318683299 0 0) 0x7f5af8003610 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 >> v1:10.20.193.46:6789/0 conn(0x7f5b0c08d8d0 legacy=0x7f5b0c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 >> v1:10.20.193.43:6789/0 conn(0x7f5b0c08ddb0 legacy=0x7f5b0c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 monclient: found mon.noname-b 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c1a3ef0 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5af4002df0 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: dump: 2026-02-21T01:35:09.021 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 5 monclient: authenticate success, global_id 104132 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5af40030b0 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 1 -- 10.20.193.43:0/1015590144 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5af40034f0 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:09.022 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 4 set_mon_vals no callback set 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b037fe640 10 monclient: dump: 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 10 monclient: shutdown 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.023 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 -- 10.20.193.43:0/1015590144 >> v1:10.20.193.43:6790/0 conn(0x7f5b0c08d4d0 legacy=0x7f5b0c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 -- 10.20.193.43:0/1015590144 shutdown_connections 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 -- 10.20.193.43:0/1015590144 >> 10.20.193.43:0/1015590144 conn(0x7f5b0c08f480 msgr2=0x7f5b0c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 -- 10.20.193.43:0/1015590144 shutdown_connections 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 -- 10.20.193.43:0/1015590144 wait complete. 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 10 monclient: monmap: 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:09.024 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 librados: starting msgr at 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 librados: starting objecter 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 Processor -- start 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 -- start start 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 librados: setting wanted keys 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 1 librados: calling monclient init 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.007+0000 7f5b12e13640 10 monclient: init 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient(hunting): picked mon.noname-b con 0x7f5b0c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient(hunting): picked mon.noname-c con 0x7f5b0c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient(hunting): picked mon.noname-a con 0x7f5b0c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c12d120 con 0x7f5b0c08ddb0 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c12d400 con 0x7f5b0c08d4d0 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0c12d9c0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.025 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient(hunting): authenticate will time out at 1040.714197s 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b03fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f5b0c08d8d0 0x7f5b0c086ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58366/0 (socket says 10.20.193.43:58366) 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b03fff640 1 -- 10.20.193.43:0/795424863 learned_addr learned my addr 10.20.193.43:0/795424863 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 client.?.objecter ms_handle_connect 0x7f5b0c08d8d0 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 client.?.objecter ms_handle_connect 0x7f5b0c08ddb0 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691882191 0 0) 0x7f5b0c12d9c0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): my global_id is 104135 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5adc003610 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907529728 0 0) 0x7f5b0c12d120 con 0x7f5b0c08ddb0 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.026 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): my global_id is 25173 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b0c12d9c0 con 0x7f5b0c08ddb0 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1414195508 0 0) 0x7f5adc003610 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b0c12d120 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5af4002db0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): dump: 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.027 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 358791942 0 0) 0x7f5b0c12d120 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 >> v1:10.20.193.46:6789/0 conn(0x7f5b0c08d4d0 legacy=0x7f5b0c0867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 >> v1:10.20.193.43:6789/0 conn(0x7f5b0c08ddb0 legacy=0x7f5b0c18ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 monclient: found mon.c 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.028 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c08c760 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 5 monclient: authenticate success, global_id 104135 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _renew_subs 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c12d6e0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 client.104135.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:09.029 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _renew_subs 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b0c0875f0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 1 librados: init done 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5af4004ca0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f5af40029a0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:09.030 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b017fa640 10 monclient: dump: 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.031 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b02ffd640 4 set_mon_vals no callback set 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.008+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c087920 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f5af4011630 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.032 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f5af404e0e0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b017fa640 10 client.104135.objecter ms_dispatch2 0x7f5b0c000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b017fa640 3 client.104135.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b017fa640 3 client.104135.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b017fa640 20 client.104135.objecter dump_active .. 0 homeless 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b10b88640 10 monclient: get_auth_request con 0x7f5adc03e730 auth_method 0 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.009+0000 7f5b017fa640 10 client.104135.objecter ms_handle_connect 0x7f5adc03e730 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.011+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f5af40177c0 con 0x7f5b0c08d8d0 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.011+0000 7f5b017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.033 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.011+0000 7f5b017fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:09.117 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.116+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b0c08edd0 con 0x7f5adc03e730 2026-02-21T01:35:09.119 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.117+0000 7f5b017fa640 1 -- 10.20.193.43:0/795424863 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114080 (unknown 2965378022 0 2561535979) 0x7f5b0c08edd0 con 0x7f5adc03e730 2026-02-21T01:35:09.120 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:35:09.121 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:35:09.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 10 librados: watch_flush enter 2026-02-21T01:35:09.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 10 librados: watch_flush exit 2026-02-21T01:35:09.123 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 20 client.104135.objecter shutdown clearing up homeless session... 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 10 client.104135.objecter successfully canceled tick 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 >> v1:10.20.193.46:6812/860801619 conn(0x7f5adc03e730 legacy=0x7f5adc05ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 10 monclient: shutdown 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 >> v1:10.20.193.43:6790/0 conn(0x7f5b0c08d8d0 legacy=0x7f5b0c086ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 shutdown_connections 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 >> 10.20.193.43:0/795424863 conn(0x7f5b0c08f480 msgr2=0x7f5b0c1a3320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 shutdown_connections 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 1 -- 10.20.193.43:0/795424863 wait complete. 2026-02-21T01:35:09.124 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.118+0000 7f5b12e13640 1 librados: shutdown 2026-02-21T01:35:09.127 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":536,"stamp":"2026-02-21T01:35:08.666106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":391824,"kb_used_data":31536,"kb_used_omap":23534,"kb_used_meta":336657,"kb_avail":565839216,"statfs":{"total":579820584960,"available":579419357184,"internally_reserved":0,"allocated":32292864,"data_stored":15397220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24099003,"internal_metadata":344737605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001205"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429993+0000","last_change":"2026-02-21T01:28:23.945241+0000","last_active":"2026-02-21T01:34:04.429993+0000","last_peered":"2026-02-21T01:34:04.429993+0000","last_clean":"2026-02-21T01:34:04.429993+0000","last_became_active":"2026-02-21T01:28:23.922684+0000","last_became_peered":"2026-02-21T01:28:23.922684+0000","last_unstale":"2026-02-21T01:34:04.429993+0000","last_undegraded":"2026-02-21T01:34:04.429993+0000","last_fullsized":"2026-02-21T01:34:04.429993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.725896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510194+0000","last_change":"2026-02-21T01:28:23.903534+0000","last_active":"2026-02-21T01:34:05.510194+0000","last_peered":"2026-02-21T01:34:05.510194+0000","last_clean":"2026-02-21T01:34:05.510194+0000","last_became_active":"2026-02-21T01:28:23.901014+0000","last_became_peered":"2026-02-21T01:28:23.901014+0000","last_unstale":"2026-02-21T01:34:05.510194+0000","last_undegraded":"2026-02-21T01:34:05.510194+0000","last_fullsized":"2026-02-21T01:34:05.510194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510216+0000","last_change":"2026-02-21T01:28:23.915336+0000","last_active":"2026-02-21T01:34:05.510216+0000","last_peered":"2026-02-21T01:34:05.510216+0000","last_clean":"2026-02-21T01:34:05.510216+0000","last_became_active":"2026-02-21T01:28:23.899839+0000","last_became_peered":"2026-02-21T01:28:23.899839+0000","last_unstale":"2026-02-21T01:34:05.510216+0000","last_undegraded":"2026-02-21T01:34:05.510216+0000","last_fullsized":"2026-02-21T01:34:05.510216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:21.620145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429956+0000","last_change":"2026-02-21T01:28:23.941012+0000","last_active":"2026-02-21T01:34:04.429956+0000","last_peered":"2026-02-21T01:34:04.429956+0000","last_clean":"2026-02-21T01:34:04.429956+0000","last_became_active":"2026-02-21T01:28:23.922704+0000","last_became_peered":"2026-02-21T01:28:23.922704+0000","last_unstale":"2026-02-21T01:34:04.429956+0000","last_undegraded":"2026-02-21T01:34:04.429956+0000","last_fullsized":"2026-02-21T01:34:04.429956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:59:39.930589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431997+0000","last_change":"2026-02-21T01:28:23.891399+0000","last_active":"2026-02-21T01:34:04.431997+0000","last_peered":"2026-02-21T01:34:04.431997+0000","last_clean":"2026-02-21T01:34:04.431997+0000","last_became_active":"2026-02-21T01:28:23.888345+0000","last_became_peered":"2026-02-21T01:28:23.888345+0000","last_unstale":"2026-02-21T01:34:04.431997+0000","last_undegraded":"2026-02-21T01:34:04.431997+0000","last_fullsized":"2026-02-21T01:34:04.431997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:03:38.993396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":602,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510784+0000","last_change":"2026-02-21T01:28:23.902177+0000","last_active":"2026-02-21T01:34:05.510784+0000","last_peered":"2026-02-21T01:34:05.510784+0000","last_clean":"2026-02-21T01:34:05.510784+0000","last_became_active":"2026-02-21T01:28:23.900280+0000","last_became_peered":"2026-02-21T01:28:23.900280+0000","last_unstale":"2026-02-21T01:34:05.510784+0000","last_undegraded":"2026-02-21T01:34:05.510784+0000","last_fullsized":"2026-02-21T01:34:05.510784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:30:10.284746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510674+0000","last_change":"2026-02-21T01:28:23.922714+0000","last_active":"2026-02-21T01:34:05.510674+0000","last_peered":"2026-02-21T01:34:05.510674+0000","last_clean":"2026-02-21T01:34:05.510674+0000","last_became_active":"2026-02-21T01:28:23.915403+0000","last_became_peered":"2026-02-21T01:28:23.915403+0000","last_unstale":"2026-02-21T01:34:05.510674+0000","last_undegraded":"2026-02-21T01:34:05.510674+0000","last_fullsized":"2026-02-21T01:34:05.510674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:16:45.257976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510399+0000","last_change":"2026-02-21T01:28:23.913408+0000","last_active":"2026-02-21T01:34:05.510399+0000","last_peered":"2026-02-21T01:34:05.510399+0000","last_clean":"2026-02-21T01:34:05.510399+0000","last_became_active":"2026-02-21T01:28:23.912821+0000","last_became_peered":"2026-02-21T01:28:23.912821+0000","last_unstale":"2026-02-21T01:34:05.510399+0000","last_undegraded":"2026-02-21T01:34:05.510399+0000","last_fullsized":"2026-02-21T01:34:05.510399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:13:33.758245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429984+0000","last_change":"2026-02-21T01:28:23.959484+0000","last_active":"2026-02-21T01:34:04.429984+0000","last_peered":"2026-02-21T01:34:04.429984+0000","last_clean":"2026-02-21T01:34:04.429984+0000","last_became_active":"2026-02-21T01:28:23.953780+0000","last_became_peered":"2026-02-21T01:28:23.953780+0000","last_unstale":"2026-02-21T01:34:04.429984+0000","last_undegraded":"2026-02-21T01:34:04.429984+0000","last_fullsized":"2026-02-21T01:34:04.429984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:09:52.644681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431341+0000","last_change":"2026-02-21T01:28:23.922395+0000","last_active":"2026-02-21T01:34:04.431341+0000","last_peered":"2026-02-21T01:34:04.431341+0000","last_clean":"2026-02-21T01:34:04.431341+0000","last_became_active":"2026-02-21T01:28:23.921588+0000","last_became_peered":"2026-02-21T01:28:23.921588+0000","last_unstale":"2026-02-21T01:34:04.431341+0000","last_undegraded":"2026-02-21T01:34:04.431341+0000","last_fullsized":"2026-02-21T01:34:04.431341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:18:14.248475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510230+0000","last_change":"2026-02-21T01:28:23.919446+0000","last_active":"2026-02-21T01:34:05.510230+0000","last_peered":"2026-02-21T01:34:05.510230+0000","last_clean":"2026-02-21T01:34:05.510230+0000","last_became_active":"2026-02-21T01:28:23.915407+0000","last_became_peered":"2026-02-21T01:28:23.915407+0000","last_unstale":"2026-02-21T01:34:05.510230+0000","last_undegraded":"2026-02-21T01:34:05.510230+0000","last_fullsized":"2026-02-21T01:34:05.510230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T08:19:21.219982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510438+0000","last_change":"2026-02-21T01:28:23.922558+0000","last_active":"2026-02-21T01:34:05.510438+0000","last_peered":"2026-02-21T01:34:05.510438+0000","last_clean":"2026-02-21T01:34:05.510438+0000","last_became_active":"2026-02-21T01:28:23.913824+0000","last_became_peered":"2026-02-21T01:28:23.913824+0000","last_unstale":"2026-02-21T01:34:05.510438+0000","last_undegraded":"2026-02-21T01:34:05.510438+0000","last_fullsized":"2026-02-21T01:34:05.510438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:11.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511918+0000","last_change":"2026-02-21T01:28:23.941204+0000","last_active":"2026-02-21T01:34:05.511918+0000","last_peered":"2026-02-21T01:34:05.511918+0000","last_clean":"2026-02-21T01:34:05.511918+0000","last_became_active":"2026-02-21T01:28:23.938182+0000","last_became_peered":"2026-02-21T01:28:23.938182+0000","last_unstale":"2026-02-21T01:34:05.511918+0000","last_undegraded":"2026-02-21T01:34:05.511918+0000","last_fullsized":"2026-02-21T01:34:05.511918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:58:59.794230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510620+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:34:05.510620+0000","last_peered":"2026-02-21T01:34:05.510620+0000","last_clean":"2026-02-21T01:34:05.510620+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:34:05.510620+0000","last_undegraded":"2026-02-21T01:34:05.510620+0000","last_fullsized":"2026-02-21T01:34:05.510620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430078+0000","last_change":"2026-02-21T01:28:23.930558+0000","last_active":"2026-02-21T01:34:04.430078+0000","last_peered":"2026-02-21T01:34:04.430078+0000","last_clean":"2026-02-21T01:34:04.430078+0000","last_became_active":"2026-02-21T01:28:23.915990+0000","last_became_peered":"2026-02-21T01:28:23.915990+0000","last_unstale":"2026-02-21T01:34:04.430078+0000","last_undegraded":"2026-02-21T01:34:04.430078+0000","last_fullsized":"2026-02-21T01:34:04.430078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:07:49.065119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510797+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:34:05.510797+0000","last_peered":"2026-02-21T01:34:05.510797+0000","last_clean":"2026-02-21T01:34:05.510797+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:34:05.510797+0000","last_undegraded":"2026-02-21T01:34:05.510797+0000","last_fullsized":"2026-02-21T01:34:05.510797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432400+0000","last_change":"2026-02-21T01:28:23.871764+0000","last_active":"2026-02-21T01:34:04.432400+0000","last_peered":"2026-02-21T01:34:04.432400+0000","last_clean":"2026-02-21T01:34:04.432400+0000","last_became_active":"2026-02-21T01:28:23.869997+0000","last_became_peered":"2026-02-21T01:28:23.869997+0000","last_unstale":"2026-02-21T01:34:04.432400+0000","last_undegraded":"2026-02-21T01:34:04.432400+0000","last_fullsized":"2026-02-21T01:34:04.432400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:28:18.194059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510519+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:34:05.510519+0000","last_peered":"2026-02-21T01:34:05.510519+0000","last_clean":"2026-02-21T01:34:05.510519+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:34:05.510519+0000","last_undegraded":"2026-02-21T01:34:05.510519+0000","last_fullsized":"2026-02-21T01:34:05.510519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"22'11","reported_seq":622,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510740+0000","last_change":"2026-02-21T01:28:23.890310+0000","last_active":"2026-02-21T01:34:05.510740+0000","last_peered":"2026-02-21T01:34:05.510740+0000","last_clean":"2026-02-21T01:34:05.510740+0000","last_became_active":"2026-02-21T01:28:23.889305+0000","last_became_peered":"2026-02-21T01:28:23.889305+0000","last_unstale":"2026-02-21T01:34:05.510740+0000","last_undegraded":"2026-02-21T01:34:05.510740+0000","last_fullsized":"2026-02-21T01:34:05.510740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:40.956411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510721+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:34:05.510721+0000","last_peered":"2026-02-21T01:34:05.510721+0000","last_clean":"2026-02-21T01:34:05.510721+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:34:05.510721+0000","last_undegraded":"2026-02-21T01:34:05.510721+0000","last_fullsized":"2026-02-21T01:34:05.510721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":608,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510617+0000","last_change":"2026-02-21T01:28:23.930311+0000","last_active":"2026-02-21T01:34:05.510617+0000","last_peered":"2026-02-21T01:34:05.510617+0000","last_clean":"2026-02-21T01:34:05.510617+0000","last_became_active":"2026-02-21T01:28:23.924669+0000","last_became_peered":"2026-02-21T01:28:23.924669+0000","last_unstale":"2026-02-21T01:34:05.510617+0000","last_undegraded":"2026-02-21T01:34:05.510617+0000","last_fullsized":"2026-02-21T01:34:05.510617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:46:07.181375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":614,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431472+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:34:04.431472+0000","last_peered":"2026-02-21T01:34:04.431472+0000","last_clean":"2026-02-21T01:34:04.431472+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:34:04.431472+0000","last_undegraded":"2026-02-21T01:34:04.431472+0000","last_fullsized":"2026-02-21T01:34:04.431472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430071+0000","last_change":"2026-02-21T01:28:23.933934+0000","last_active":"2026-02-21T01:34:04.430071+0000","last_peered":"2026-02-21T01:34:04.430071+0000","last_clean":"2026-02-21T01:34:04.430071+0000","last_became_active":"2026-02-21T01:28:23.926401+0000","last_became_peered":"2026-02-21T01:28:23.926401+0000","last_unstale":"2026-02-21T01:34:04.430071+0000","last_undegraded":"2026-02-21T01:34:04.430071+0000","last_fullsized":"2026-02-21T01:34:04.430071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:40:24.787719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512684+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:34:05.512684+0000","last_peered":"2026-02-21T01:34:05.512684+0000","last_clean":"2026-02-21T01:34:05.512684+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:34:05.512684+0000","last_undegraded":"2026-02-21T01:34:05.512684+0000","last_fullsized":"2026-02-21T01:34:05.512684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512312+0000","last_change":"2026-02-21T01:28:23.920345+0000","last_active":"2026-02-21T01:34:05.512312+0000","last_peered":"2026-02-21T01:34:05.512312+0000","last_clean":"2026-02-21T01:34:05.512312+0000","last_became_active":"2026-02-21T01:28:23.914843+0000","last_became_peered":"2026-02-21T01:28:23.914843+0000","last_unstale":"2026-02-21T01:34:05.512312+0000","last_undegraded":"2026-02-21T01:34:05.512312+0000","last_fullsized":"2026-02-21T01:34:05.512312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:01:52.859059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510234+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:34:05.510234+0000","last_peered":"2026-02-21T01:34:05.510234+0000","last_clean":"2026-02-21T01:34:05.510234+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:34:05.510234+0000","last_undegraded":"2026-02-21T01:34:05.510234+0000","last_fullsized":"2026-02-21T01:34:05.510234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430076+0000","last_change":"2026-02-21T01:28:23.920796+0000","last_active":"2026-02-21T01:34:04.430076+0000","last_peered":"2026-02-21T01:34:04.430076+0000","last_clean":"2026-02-21T01:34:04.430076+0000","last_became_active":"2026-02-21T01:28:23.915656+0000","last_became_peered":"2026-02-21T01:28:23.915656+0000","last_unstale":"2026-02-21T01:34:04.430076+0000","last_undegraded":"2026-02-21T01:34:04.430076+0000","last_fullsized":"2026-02-21T01:34:04.430076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:51:20.257392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432963+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:34:04.432963+0000","last_peered":"2026-02-21T01:34:04.432963+0000","last_clean":"2026-02-21T01:34:04.432963+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:34:04.432963+0000","last_undegraded":"2026-02-21T01:34:04.432963+0000","last_fullsized":"2026-02-21T01:34:04.432963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":760,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510225+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:34:05.510225+0000","last_peered":"2026-02-21T01:34:05.510225+0000","last_clean":"2026-02-21T01:34:05.510225+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:34:05.510225+0000","last_undegraded":"2026-02-21T01:34:05.510225+0000","last_fullsized":"2026-02-21T01:34:05.510225+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510521+0000","last_change":"2026-02-21T01:28:23.888153+0000","last_active":"2026-02-21T01:34:05.510521+0000","last_peered":"2026-02-21T01:34:05.510521+0000","last_clean":"2026-02-21T01:34:05.510521+0000","last_became_active":"2026-02-21T01:28:23.886858+0000","last_became_peered":"2026-02-21T01:28:23.886858+0000","last_unstale":"2026-02-21T01:34:05.510521+0000","last_undegraded":"2026-02-21T01:34:05.510521+0000","last_fullsized":"2026-02-21T01:34:05.510521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:00:16.121993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":595,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512458+0000","last_change":"2026-02-21T01:28:23.902882+0000","last_active":"2026-02-21T01:34:05.512458+0000","last_peered":"2026-02-21T01:34:05.512458+0000","last_clean":"2026-02-21T01:34:05.512458+0000","last_became_active":"2026-02-21T01:28:23.897729+0000","last_became_peered":"2026-02-21T01:28:23.897729+0000","last_unstale":"2026-02-21T01:34:05.512458+0000","last_undegraded":"2026-02-21T01:34:05.512458+0000","last_fullsized":"2026-02-21T01:34:05.512458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:54:58.723961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511931+0000","last_change":"2026-02-21T01:28:23.915267+0000","last_active":"2026-02-21T01:34:05.511931+0000","last_peered":"2026-02-21T01:34:05.511931+0000","last_clean":"2026-02-21T01:34:05.511931+0000","last_became_active":"2026-02-21T01:28:23.914559+0000","last_became_peered":"2026-02-21T01:28:23.914559+0000","last_unstale":"2026-02-21T01:34:05.511931+0000","last_undegraded":"2026-02-21T01:34:05.511931+0000","last_fullsized":"2026-02-21T01:34:05.511931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:50:14.365478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430087+0000","last_change":"2026-02-21T01:28:23.915431+0000","last_active":"2026-02-21T01:34:04.430087+0000","last_peered":"2026-02-21T01:34:04.430087+0000","last_clean":"2026-02-21T01:34:04.430087+0000","last_became_active":"2026-02-21T01:28:23.912391+0000","last_became_peered":"2026-02-21T01:28:23.912391+0000","last_unstale":"2026-02-21T01:34:04.430087+0000","last_undegraded":"2026-02-21T01:34:04.430087+0000","last_fullsized":"2026-02-21T01:34:04.430087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:02:54.959438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511153+0000","last_change":"2026-02-21T01:28:23.934029+0000","last_active":"2026-02-21T01:34:05.511153+0000","last_peered":"2026-02-21T01:34:05.511153+0000","last_clean":"2026-02-21T01:34:05.511153+0000","last_became_active":"2026-02-21T01:28:23.930449+0000","last_became_peered":"2026-02-21T01:28:23.930449+0000","last_unstale":"2026-02-21T01:34:05.511153+0000","last_undegraded":"2026-02-21T01:34:05.511153+0000","last_fullsized":"2026-02-21T01:34:05.511153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:48:42.258342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430005+0000","last_change":"2026-02-21T01:28:23.931187+0000","last_active":"2026-02-21T01:34:04.430005+0000","last_peered":"2026-02-21T01:34:04.430005+0000","last_clean":"2026-02-21T01:34:04.430005+0000","last_became_active":"2026-02-21T01:28:23.921627+0000","last_became_peered":"2026-02-21T01:28:23.921627+0000","last_unstale":"2026-02-21T01:34:04.430005+0000","last_undegraded":"2026-02-21T01:34:04.430005+0000","last_fullsized":"2026-02-21T01:34:04.430005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:50:18.522770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511401+0000","last_change":"2026-02-21T01:28:23.945564+0000","last_active":"2026-02-21T01:34:05.511401+0000","last_peered":"2026-02-21T01:34:05.511401+0000","last_clean":"2026-02-21T01:34:05.511401+0000","last_became_active":"2026-02-21T01:28:23.945129+0000","last_became_peered":"2026-02-21T01:28:23.945129+0000","last_unstale":"2026-02-21T01:34:05.511401+0000","last_undegraded":"2026-02-21T01:34:05.511401+0000","last_fullsized":"2026-02-21T01:34:05.511401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:41:28.842721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510574+0000","last_change":"2026-02-21T01:28:23.881341+0000","last_active":"2026-02-21T01:34:05.510574+0000","last_peered":"2026-02-21T01:34:05.510574+0000","last_clean":"2026-02-21T01:34:05.510574+0000","last_became_active":"2026-02-21T01:28:23.880056+0000","last_became_peered":"2026-02-21T01:28:23.880056+0000","last_unstale":"2026-02-21T01:34:05.510574+0000","last_undegraded":"2026-02-21T01:34:05.510574+0000","last_fullsized":"2026-02-21T01:34:05.510574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:56:36.344912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510530+0000","last_change":"2026-02-21T01:28:23.925048+0000","last_active":"2026-02-21T01:34:05.510530+0000","last_peered":"2026-02-21T01:34:05.510530+0000","last_clean":"2026-02-21T01:34:05.510530+0000","last_became_active":"2026-02-21T01:28:23.916467+0000","last_became_peered":"2026-02-21T01:28:23.916467+0000","last_unstale":"2026-02-21T01:34:05.510530+0000","last_undegraded":"2026-02-21T01:34:05.510530+0000","last_fullsized":"2026-02-21T01:34:05.510530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:59.497146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510414+0000","last_change":"2026-02-21T01:28:23.918503+0000","last_active":"2026-02-21T01:34:05.510414+0000","last_peered":"2026-02-21T01:34:05.510414+0000","last_clean":"2026-02-21T01:34:05.510414+0000","last_became_active":"2026-02-21T01:28:23.916777+0000","last_became_peered":"2026-02-21T01:28:23.916777+0000","last_unstale":"2026-02-21T01:34:05.510414+0000","last_undegraded":"2026-02-21T01:34:05.510414+0000","last_fullsized":"2026-02-21T01:34:05.510414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:50:28.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":595,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512361+0000","last_change":"2026-02-21T01:28:23.895892+0000","last_active":"2026-02-21T01:34:05.512361+0000","last_peered":"2026-02-21T01:34:05.512361+0000","last_clean":"2026-02-21T01:34:05.512361+0000","last_became_active":"2026-02-21T01:28:23.895201+0000","last_became_peered":"2026-02-21T01:28:23.895201+0000","last_unstale":"2026-02-21T01:34:05.512361+0000","last_undegraded":"2026-02-21T01:34:05.512361+0000","last_fullsized":"2026-02-21T01:34:05.512361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:21:32.687664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431794+0000","last_change":"2026-02-21T01:28:23.890053+0000","last_active":"2026-02-21T01:34:04.431794+0000","last_peered":"2026-02-21T01:34:04.431794+0000","last_clean":"2026-02-21T01:34:04.431794+0000","last_became_active":"2026-02-21T01:28:23.886126+0000","last_became_peered":"2026-02-21T01:28:23.886126+0000","last_unstale":"2026-02-21T01:34:04.431794+0000","last_undegraded":"2026-02-21T01:34:04.431794+0000","last_fullsized":"2026-02-21T01:34:04.431794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:16:07.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":5814,"kb_used_meta":57225,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5954498,"internal_metadata":58598462},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640346,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":8625,"kb_used_meta":54414,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8832023,"internal_metadata":55720937},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640346,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68656,"kb_used_data":5600,"kb_used_omap":205,"kb_used_meta":62834,"kb_avail":94303184,"statfs":{"total":96636764160,"available":96566460416,"internally_reserved":0,"allocated":5734400,"data_stored":2918814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210051,"internal_metadata":64342909},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640345,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68136,"kb_used_data":5080,"kb_used_omap":5681,"kb_used_meta":57358,"kb_avail":94303704,"statfs":{"total":96636764160,"available":96566992896,"internally_reserved":0,"allocated":5201920,"data_stored":2389886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5818260,"internal_metadata":58734700},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640345,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50092,"kb_used_data":5084,"kb_used_omap":201,"kb_used_meta":44790,"kb_avail":94321748,"statfs":{"total":96636764160,"available":96585469952,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":206623,"internal_metadata":45865185},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640345,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68660,"kb_used_data":5604,"kb_used_omap":3005,"kb_used_meta":60034,"kb_avail":94303180,"statfs":{"total":96636764160,"available":96566456320,"internally_reserved":0,"allocated":5738496,"data_stored":2918819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3077548,"internal_metadata":61475412},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:35:09.131 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient: get_monmap_and_config 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient: monmap: 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:09.198478+0000 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:09.198478+0000 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:09.198 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 1 Processor -- start 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 1 -- start start 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient: init 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f1d4808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f1d4808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f1d4808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4808a690 con 0x7f1d4808d4d0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4808b910 con 0x7f1d4808d8d0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d48088ae0 con 0x7f1d4808ddb0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d4e7fa640 10 monclient(hunting): authenticate will time out at 1040.903901s 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d47fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f1d4808ddb0 0x7f1d4808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58376/0 (socket says 10.20.193.43:58376) 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d47fff640 1 -- 10.20.193.43:0/3997180040 learned_addr learned my addr 10.20.193.43:0/3997180040 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.197+0000 7f1d477fe640 1 --1- 10.20.193.43:0/3997180040 >> v1:10.20.193.43:6789/0 conn(0x7f1d4808d4d0 0x7f1d4817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33116/0 (socket says 10.20.193.43:33116) 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375737299 0 0) 0x7f1d48088ae0 con 0x7f1d4808ddb0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): my global_id is 104138 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d2c003610 con 0x7f1d4808ddb0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390317407 0 0) 0x7f1d4808a690 con 0x7f1d4808d4d0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient(hunting): my global_id is 25176 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d48088ae0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 970313917 0 0) 0x7f1d48088ae0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 >> v1:10.20.193.43:6790/0 conn(0x7f1d4808ddb0 legacy=0x7f1d4808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 >> v1:10.20.193.46:6789/0 conn(0x7f1d4808d8d0 legacy=0x7f1d4819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 monclient: found mon.noname-a 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:09.200 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d481a3ef0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1d38002df0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: dump: 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 5 monclient: authenticate success, global_id 25176 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d38003000 con 0x7f1d4808d4d0 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 1 -- 10.20.193.43:0/3997180040 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1d38003440 con 0x7f1d4808d4d0 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d46ffd640 10 monclient: dump: 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 4 set_mon_vals no callback set 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 10 monclient: shutdown 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/3997180040 >> v1:10.20.193.43:6789/0 conn(0x7f1d4808d4d0 legacy=0x7f1d4817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.201 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/3997180040 shutdown_connections 2026-02-21T01:35:09.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/3997180040 >> 10.20.193.43:0/3997180040 conn(0x7f1d4808f480 msgr2=0x7f1d4808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/3997180040 shutdown_connections 2026-02-21T01:35:09.202 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.198+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/3997180040 wait complete. 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: monmap: 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 librados: starting msgr at 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 librados: starting objecter 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 Processor -- start 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 -- start start 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 librados: setting wanted keys 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 librados: calling monclient init 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: init 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f1d4808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.203 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f1d4808d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f1d4808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4812d6f0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4813a610 con 0x7f1d4808d8d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4812d9d0 con 0x7f1d4808ddb0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient(hunting): authenticate will time out at 1040.905557s 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d47fff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f1d4808d4d0 0x7f1d48086800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33128/0 (socket says 10.20.193.43:33128) 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d47fff640 1 -- 10.20.193.43:0/1517237034 learned_addr learned my addr 10.20.193.43:0/1517237034 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 client.?.objecter ms_handle_connect 0x7f1d4808d4d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 client.?.objecter ms_handle_connect 0x7f1d4808ddb0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882198320 0 0) 0x7f1d4812d6f0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): my global_id is 25179 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d18003610 con 0x7f1d4808d4d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2585947251 0 0) 0x7f1d4812d9d0 con 0x7f1d4808ddb0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): my global_id is 104141 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d4812d6f0 con 0x7f1d4808ddb0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2813305965 0 0) 0x7f1d18003610 con 0x7f1d4808d4d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d4812d9d0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1d34003240 con 0x7f1d4808d4d0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:09.204 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1418256226 0 0) 0x7f1d4812d6f0 con 0x7f1d4808ddb0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d18003610 con 0x7f1d4808ddb0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1d3c0032d0 con 0x7f1d4808ddb0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1711147423 0 0) 0x7f1d4812d9d0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 >> v1:10.20.193.43:6790/0 conn(0x7f1d4808ddb0 legacy=0x7f1d4818ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 >> v1:10.20.193.46:6789/0 conn(0x7f1d4808d8d0 legacy=0x7f1d48086f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 monclient: found mon.a 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4805cbc0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 5 monclient: authenticate success, global_id 25179 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: _renew_subs 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4812d410 con 0x7f1d4808d4d0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 client.25179.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: _renew_subs 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d48087620 con 0x7f1d4808d4d0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d4e7fa640 1 librados: init done 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d34003530 con 0x7f1d4808d4d0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.199+0000 7f1d44ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f1d34004d20 con 0x7f1d4808d4d0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d467fc640 4 set_mon_vals no callback set 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 10 monclient: dump: 2026-02-21T01:35:09.205 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d4e7fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d4e7fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d4e7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d48087960 con 0x7f1d4808d4d0 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f1d340116a0 con 0x7f1d4808d4d0 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f1d3404e250 con 0x7f1d4808d4d0 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 10 client.25179.objecter ms_dispatch2 0x7f1d48000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 3 client.25179.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 3 client.25179.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d44ff9640 20 client.25179.objecter dump_active .. 0 homeless 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.200+0000 7f1d477fe640 10 monclient: get_auth_request con 0x7f1d1803e930 auth_method 0 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.201+0000 7f1d44ff9640 10 client.25179.objecter ms_handle_connect 0x7f1d1803e930 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.202+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f1d48087960 con 0x7f1d4808d4d0 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.202+0000 7f1d44ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.206 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.202+0000 7f1d44ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:09.314 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.312+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d4808ed90 con 0x7f1d1803e930 2026-02-21T01:35:09.315 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.314+0000 7f1d44ff9640 1 -- 10.20.193.43:0/1517237034 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114080 (unknown 2965378022 0 2561535979) 0x7f1d4808ed90 con 0x7f1d1803e930 2026-02-21T01:35:09.316 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:35:09.317 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:35:09.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.314+0000 7f1d4e7fa640 10 librados: watch_flush enter 2026-02-21T01:35:09.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.314+0000 7f1d4e7fa640 10 librados: watch_flush exit 2026-02-21T01:35:09.318 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.314+0000 7f1d4e7fa640 20 client.25179.objecter shutdown clearing up homeless session... 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.314+0000 7f1d4e7fa640 10 client.25179.objecter successfully canceled tick 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 >> v1:10.20.193.46:6812/860801619 conn(0x7f1d1803e930 legacy=0x7f1d1805ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 10 monclient: shutdown 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 >> v1:10.20.193.43:6789/0 conn(0x7f1d4808d4d0 legacy=0x7f1d48086800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 shutdown_connections 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 >> 10.20.193.43:0/1517237034 conn(0x7f1d4808f480 msgr2=0x7f1d481a1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 shutdown_connections 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 1 -- 10.20.193.43:0/1517237034 wait complete. 2026-02-21T01:35:09.319 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.315+0000 7f1d4e7fa640 1 librados: shutdown 2026-02-21T01:35:09.324 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":536,"stamp":"2026-02-21T01:35:08.666106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":391824,"kb_used_data":31536,"kb_used_omap":23534,"kb_used_meta":336657,"kb_avail":565839216,"statfs":{"total":579820584960,"available":579419357184,"internally_reserved":0,"allocated":32292864,"data_stored":15397220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24099003,"internal_metadata":344737605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001205"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429993+0000","last_change":"2026-02-21T01:28:23.945241+0000","last_active":"2026-02-21T01:34:04.429993+0000","last_peered":"2026-02-21T01:34:04.429993+0000","last_clean":"2026-02-21T01:34:04.429993+0000","last_became_active":"2026-02-21T01:28:23.922684+0000","last_became_peered":"2026-02-21T01:28:23.922684+0000","last_unstale":"2026-02-21T01:34:04.429993+0000","last_undegraded":"2026-02-21T01:34:04.429993+0000","last_fullsized":"2026-02-21T01:34:04.429993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.725896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510194+0000","last_change":"2026-02-21T01:28:23.903534+0000","last_active":"2026-02-21T01:34:05.510194+0000","last_peered":"2026-02-21T01:34:05.510194+0000","last_clean":"2026-02-21T01:34:05.510194+0000","last_became_active":"2026-02-21T01:28:23.901014+0000","last_became_peered":"2026-02-21T01:28:23.901014+0000","last_unstale":"2026-02-21T01:34:05.510194+0000","last_undegraded":"2026-02-21T01:34:05.510194+0000","last_fullsized":"2026-02-21T01:34:05.510194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510216+0000","last_change":"2026-02-21T01:28:23.915336+0000","last_active":"2026-02-21T01:34:05.510216+0000","last_peered":"2026-02-21T01:34:05.510216+0000","last_clean":"2026-02-21T01:34:05.510216+0000","last_became_active":"2026-02-21T01:28:23.899839+0000","last_became_peered":"2026-02-21T01:28:23.899839+0000","last_unstale":"2026-02-21T01:34:05.510216+0000","last_undegraded":"2026-02-21T01:34:05.510216+0000","last_fullsized":"2026-02-21T01:34:05.510216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:21.620145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429956+0000","last_change":"2026-02-21T01:28:23.941012+0000","last_active":"2026-02-21T01:34:04.429956+0000","last_peered":"2026-02-21T01:34:04.429956+0000","last_clean":"2026-02-21T01:34:04.429956+0000","last_became_active":"2026-02-21T01:28:23.922704+0000","last_became_peered":"2026-02-21T01:28:23.922704+0000","last_unstale":"2026-02-21T01:34:04.429956+0000","last_undegraded":"2026-02-21T01:34:04.429956+0000","last_fullsized":"2026-02-21T01:34:04.429956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:59:39.930589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431997+0000","last_change":"2026-02-21T01:28:23.891399+0000","last_active":"2026-02-21T01:34:04.431997+0000","last_peered":"2026-02-21T01:34:04.431997+0000","last_clean":"2026-02-21T01:34:04.431997+0000","last_became_active":"2026-02-21T01:28:23.888345+0000","last_became_peered":"2026-02-21T01:28:23.888345+0000","last_unstale":"2026-02-21T01:34:04.431997+0000","last_undegraded":"2026-02-21T01:34:04.431997+0000","last_fullsized":"2026-02-21T01:34:04.431997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:03:38.993396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":602,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510784+0000","last_change":"2026-02-21T01:28:23.902177+0000","last_active":"2026-02-21T01:34:05.510784+0000","last_peered":"2026-02-21T01:34:05.510784+0000","last_clean":"2026-02-21T01:34:05.510784+0000","last_became_active":"2026-02-21T01:28:23.900280+0000","last_became_peered":"2026-02-21T01:28:23.900280+0000","last_unstale":"2026-02-21T01:34:05.510784+0000","last_undegraded":"2026-02-21T01:34:05.510784+0000","last_fullsized":"2026-02-21T01:34:05.510784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:30:10.284746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510674+0000","last_change":"2026-02-21T01:28:23.922714+0000","last_active":"2026-02-21T01:34:05.510674+0000","last_peered":"2026-02-21T01:34:05.510674+0000","last_clean":"2026-02-21T01:34:05.510674+0000","last_became_active":"2026-02-21T01:28:23.915403+0000","last_became_peered":"2026-02-21T01:28:23.915403+0000","last_unstale":"2026-02-21T01:34:05.510674+0000","last_undegraded":"2026-02-21T01:34:05.510674+0000","last_fullsized":"2026-02-21T01:34:05.510674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:16:45.257976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510399+0000","last_change":"2026-02-21T01:28:23.913408+0000","last_active":"2026-02-21T01:34:05.510399+0000","last_peered":"2026-02-21T01:34:05.510399+0000","last_clean":"2026-02-21T01:34:05.510399+0000","last_became_active":"2026-02-21T01:28:23.912821+0000","last_became_peered":"2026-02-21T01:28:23.912821+0000","last_unstale":"2026-02-21T01:34:05.510399+0000","last_undegraded":"2026-02-21T01:34:05.510399+0000","last_fullsized":"2026-02-21T01:34:05.510399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:13:33.758245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429984+0000","last_change":"2026-02-21T01:28:23.959484+0000","last_active":"2026-02-21T01:34:04.429984+0000","last_peered":"2026-02-21T01:34:04.429984+0000","last_clean":"2026-02-21T01:34:04.429984+0000","last_became_active":"2026-02-21T01:28:23.953780+0000","last_became_peered":"2026-02-21T01:28:23.953780+0000","last_unstale":"2026-02-21T01:34:04.429984+0000","last_undegraded":"2026-02-21T01:34:04.429984+0000","last_fullsized":"2026-02-21T01:34:04.429984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:09:52.644681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431341+0000","last_change":"2026-02-21T01:28:23.922395+0000","last_active":"2026-02-21T01:34:04.431341+0000","last_peered":"2026-02-21T01:34:04.431341+0000","last_clean":"2026-02-21T01:34:04.431341+0000","last_became_active":"2026-02-21T01:28:23.921588+0000","last_became_peered":"2026-02-21T01:28:23.921588+0000","last_unstale":"2026-02-21T01:34:04.431341+0000","last_undegraded":"2026-02-21T01:34:04.431341+0000","last_fullsized":"2026-02-21T01:34:04.431341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:18:14.248475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510230+0000","last_change":"2026-02-21T01:28:23.919446+0000","last_active":"2026-02-21T01:34:05.510230+0000","last_peered":"2026-02-21T01:34:05.510230+0000","last_clean":"2026-02-21T01:34:05.510230+0000","last_became_active":"2026-02-21T01:28:23.915407+0000","last_became_peered":"2026-02-21T01:28:23.915407+0000","last_unstale":"2026-02-21T01:34:05.510230+0000","last_undegraded":"2026-02-21T01:34:05.510230+0000","last_fullsized":"2026-02-21T01:34:05.510230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T08:19:21.219982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510438+0000","last_change":"2026-02-21T01:28:23.922558+0000","last_active":"2026-02-21T01:34:05.510438+0000","last_peered":"2026-02-21T01:34:05.510438+0000","last_clean":"2026-02-21T01:34:05.510438+0000","last_became_active":"2026-02-21T01:28:23.913824+0000","last_became_peered":"2026-02-21T01:28:23.913824+0000","last_unstale":"2026-02-21T01:34:05.510438+0000","last_undegraded":"2026-02-21T01:34:05.510438+0000","last_fullsized":"2026-02-21T01:34:05.510438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:11.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511918+0000","last_change":"2026-02-21T01:28:23.941204+0000","last_active":"2026-02-21T01:34:05.511918+0000","last_peered":"2026-02-21T01:34:05.511918+0000","last_clean":"2026-02-21T01:34:05.511918+0000","last_became_active":"2026-02-21T01:28:23.938182+0000","last_became_peered":"2026-02-21T01:28:23.938182+0000","last_unstale":"2026-02-21T01:34:05.511918+0000","last_undegraded":"2026-02-21T01:34:05.511918+0000","last_fullsized":"2026-02-21T01:34:05.511918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:58:59.794230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510620+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:34:05.510620+0000","last_peered":"2026-02-21T01:34:05.510620+0000","last_clean":"2026-02-21T01:34:05.510620+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:34:05.510620+0000","last_undegraded":"2026-02-21T01:34:05.510620+0000","last_fullsized":"2026-02-21T01:34:05.510620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430078+0000","last_change":"2026-02-21T01:28:23.930558+0000","last_active":"2026-02-21T01:34:04.430078+0000","last_peered":"2026-02-21T01:34:04.430078+0000","last_clean":"2026-02-21T01:34:04.430078+0000","last_became_active":"2026-02-21T01:28:23.915990+0000","last_became_peered":"2026-02-21T01:28:23.915990+0000","last_unstale":"2026-02-21T01:34:04.430078+0000","last_undegraded":"2026-02-21T01:34:04.430078+0000","last_fullsized":"2026-02-21T01:34:04.430078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:07:49.065119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510797+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:34:05.510797+0000","last_peered":"2026-02-21T01:34:05.510797+0000","last_clean":"2026-02-21T01:34:05.510797+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:34:05.510797+0000","last_undegraded":"2026-02-21T01:34:05.510797+0000","last_fullsized":"2026-02-21T01:34:05.510797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432400+0000","last_change":"2026-02-21T01:28:23.871764+0000","last_active":"2026-02-21T01:34:04.432400+0000","last_peered":"2026-02-21T01:34:04.432400+0000","last_clean":"2026-02-21T01:34:04.432400+0000","last_became_active":"2026-02-21T01:28:23.869997+0000","last_became_peered":"2026-02-21T01:28:23.869997+0000","last_unstale":"2026-02-21T01:34:04.432400+0000","last_undegraded":"2026-02-21T01:34:04.432400+0000","last_fullsized":"2026-02-21T01:34:04.432400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:28:18.194059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510519+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:34:05.510519+0000","last_peered":"2026-02-21T01:34:05.510519+0000","last_clean":"2026-02-21T01:34:05.510519+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:34:05.510519+0000","last_undegraded":"2026-02-21T01:34:05.510519+0000","last_fullsized":"2026-02-21T01:34:05.510519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"22'11","reported_seq":622,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510740+0000","last_change":"2026-02-21T01:28:23.890310+0000","last_active":"2026-02-21T01:34:05.510740+0000","last_peered":"2026-02-21T01:34:05.510740+0000","last_clean":"2026-02-21T01:34:05.510740+0000","last_became_active":"2026-02-21T01:28:23.889305+0000","last_became_peered":"2026-02-21T01:28:23.889305+0000","last_unstale":"2026-02-21T01:34:05.510740+0000","last_undegraded":"2026-02-21T01:34:05.510740+0000","last_fullsized":"2026-02-21T01:34:05.510740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:40.956411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510721+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:34:05.510721+0000","last_peered":"2026-02-21T01:34:05.510721+0000","last_clean":"2026-02-21T01:34:05.510721+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:34:05.510721+0000","last_undegraded":"2026-02-21T01:34:05.510721+0000","last_fullsized":"2026-02-21T01:34:05.510721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":608,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510617+0000","last_change":"2026-02-21T01:28:23.930311+0000","last_active":"2026-02-21T01:34:05.510617+0000","last_peered":"2026-02-21T01:34:05.510617+0000","last_clean":"2026-02-21T01:34:05.510617+0000","last_became_active":"2026-02-21T01:28:23.924669+0000","last_became_peered":"2026-02-21T01:28:23.924669+0000","last_unstale":"2026-02-21T01:34:05.510617+0000","last_undegraded":"2026-02-21T01:34:05.510617+0000","last_fullsized":"2026-02-21T01:34:05.510617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:46:07.181375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":614,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431472+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:34:04.431472+0000","last_peered":"2026-02-21T01:34:04.431472+0000","last_clean":"2026-02-21T01:34:04.431472+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:34:04.431472+0000","last_undegraded":"2026-02-21T01:34:04.431472+0000","last_fullsized":"2026-02-21T01:34:04.431472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430071+0000","last_change":"2026-02-21T01:28:23.933934+0000","last_active":"2026-02-21T01:34:04.430071+0000","last_peered":"2026-02-21T01:34:04.430071+0000","last_clean":"2026-02-21T01:34:04.430071+0000","last_became_active":"2026-02-21T01:28:23.926401+0000","last_became_peered":"2026-02-21T01:28:23.926401+0000","last_unstale":"2026-02-21T01:34:04.430071+0000","last_undegraded":"2026-02-21T01:34:04.430071+0000","last_fullsized":"2026-02-21T01:34:04.430071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:40:24.787719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512684+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:34:05.512684+0000","last_peered":"2026-02-21T01:34:05.512684+0000","last_clean":"2026-02-21T01:34:05.512684+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:34:05.512684+0000","last_undegraded":"2026-02-21T01:34:05.512684+0000","last_fullsized":"2026-02-21T01:34:05.512684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512312+0000","last_change":"2026-02-21T01:28:23.920345+0000","last_active":"2026-02-21T01:34:05.512312+0000","last_peered":"2026-02-21T01:34:05.512312+0000","last_clean":"2026-02-21T01:34:05.512312+0000","last_became_active":"2026-02-21T01:28:23.914843+0000","last_became_peered":"2026-02-21T01:28:23.914843+0000","last_unstale":"2026-02-21T01:34:05.512312+0000","last_undegraded":"2026-02-21T01:34:05.512312+0000","last_fullsized":"2026-02-21T01:34:05.512312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:01:52.859059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510234+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:34:05.510234+0000","last_peered":"2026-02-21T01:34:05.510234+0000","last_clean":"2026-02-21T01:34:05.510234+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:34:05.510234+0000","last_undegraded":"2026-02-21T01:34:05.510234+0000","last_fullsized":"2026-02-21T01:34:05.510234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430076+0000","last_change":"2026-02-21T01:28:23.920796+0000","last_active":"2026-02-21T01:34:04.430076+0000","last_peered":"2026-02-21T01:34:04.430076+0000","last_clean":"2026-02-21T01:34:04.430076+0000","last_became_active":"2026-02-21T01:28:23.915656+0000","last_became_peered":"2026-02-21T01:28:23.915656+0000","last_unstale":"2026-02-21T01:34:04.430076+0000","last_undegraded":"2026-02-21T01:34:04.430076+0000","last_fullsized":"2026-02-21T01:34:04.430076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:51:20.257392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432963+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:34:04.432963+0000","last_peered":"2026-02-21T01:34:04.432963+0000","last_clean":"2026-02-21T01:34:04.432963+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:34:04.432963+0000","last_undegraded":"2026-02-21T01:34:04.432963+0000","last_fullsized":"2026-02-21T01:34:04.432963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":760,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510225+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:34:05.510225+0000","last_peered":"2026-02-21T01:34:05.510225+0000","last_clean":"2026-02-21T01:34:05.510225+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:34:05.510225+0000","last_undegraded":"2026-02-21T01:34:05.510225+0000","last_fullsized":"2026-02-21T01:34:05.510225+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510521+0000","last_change":"2026-02-21T01:28:23.888153+0000","last_active":"2026-02-21T01:34:05.510521+0000","last_peered":"2026-02-21T01:34:05.510521+0000","last_clean":"2026-02-21T01:34:05.510521+0000","last_became_active":"2026-02-21T01:28:23.886858+0000","last_became_peered":"2026-02-21T01:28:23.886858+0000","last_unstale":"2026-02-21T01:34:05.510521+0000","last_undegraded":"2026-02-21T01:34:05.510521+0000","last_fullsized":"2026-02-21T01:34:05.510521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:00:16.121993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":595,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512458+0000","last_change":"2026-02-21T01:28:23.902882+0000","last_active":"2026-02-21T01:34:05.512458+0000","last_peered":"2026-02-21T01:34:05.512458+0000","last_clean":"2026-02-21T01:34:05.512458+0000","last_became_active":"2026-02-21T01:28:23.897729+0000","last_became_peered":"2026-02-21T01:28:23.897729+0000","last_unstale":"2026-02-21T01:34:05.512458+0000","last_undegraded":"2026-02-21T01:34:05.512458+0000","last_fullsized":"2026-02-21T01:34:05.512458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:54:58.723961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511931+0000","last_change":"2026-02-21T01:28:23.915267+0000","last_active":"2026-02-21T01:34:05.511931+0000","last_peered":"2026-02-21T01:34:05.511931+0000","last_clean":"2026-02-21T01:34:05.511931+0000","last_became_active":"2026-02-21T01:28:23.914559+0000","last_became_peered":"2026-02-21T01:28:23.914559+0000","last_unstale":"2026-02-21T01:34:05.511931+0000","last_undegraded":"2026-02-21T01:34:05.511931+0000","last_fullsized":"2026-02-21T01:34:05.511931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:50:14.365478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430087+0000","last_change":"2026-02-21T01:28:23.915431+0000","last_active":"2026-02-21T01:34:04.430087+0000","last_peered":"2026-02-21T01:34:04.430087+0000","last_clean":"2026-02-21T01:34:04.430087+0000","last_became_active":"2026-02-21T01:28:23.912391+0000","last_became_peered":"2026-02-21T01:28:23.912391+0000","last_unstale":"2026-02-21T01:34:04.430087+0000","last_undegraded":"2026-02-21T01:34:04.430087+0000","last_fullsized":"2026-02-21T01:34:04.430087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:02:54.959438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511153+0000","last_change":"2026-02-21T01:28:23.934029+0000","last_active":"2026-02-21T01:34:05.511153+0000","last_peered":"2026-02-21T01:34:05.511153+0000","last_clean":"2026-02-21T01:34:05.511153+0000","last_became_active":"2026-02-21T01:28:23.930449+0000","last_became_peered":"2026-02-21T01:28:23.930449+0000","last_unstale":"2026-02-21T01:34:05.511153+0000","last_undegraded":"2026-02-21T01:34:05.511153+0000","last_fullsized":"2026-02-21T01:34:05.511153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:48:42.258342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430005+0000","last_change":"2026-02-21T01:28:23.931187+0000","last_active":"2026-02-21T01:34:04.430005+0000","last_peered":"2026-02-21T01:34:04.430005+0000","last_clean":"2026-02-21T01:34:04.430005+0000","last_became_active":"2026-02-21T01:28:23.921627+0000","last_became_peered":"2026-02-21T01:28:23.921627+0000","last_unstale":"2026-02-21T01:34:04.430005+0000","last_undegraded":"2026-02-21T01:34:04.430005+0000","last_fullsized":"2026-02-21T01:34:04.430005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:50:18.522770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511401+0000","last_change":"2026-02-21T01:28:23.945564+0000","last_active":"2026-02-21T01:34:05.511401+0000","last_peered":"2026-02-21T01:34:05.511401+0000","last_clean":"2026-02-21T01:34:05.511401+0000","last_became_active":"2026-02-21T01:28:23.945129+0000","last_became_peered":"2026-02-21T01:28:23.945129+0000","last_unstale":"2026-02-21T01:34:05.511401+0000","last_undegraded":"2026-02-21T01:34:05.511401+0000","last_fullsized":"2026-02-21T01:34:05.511401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:41:28.842721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510574+0000","last_change":"2026-02-21T01:28:23.881341+0000","last_active":"2026-02-21T01:34:05.510574+0000","last_peered":"2026-02-21T01:34:05.510574+0000","last_clean":"2026-02-21T01:34:05.510574+0000","last_became_active":"2026-02-21T01:28:23.880056+0000","last_became_peered":"2026-02-21T01:28:23.880056+0000","last_unstale":"2026-02-21T01:34:05.510574+0000","last_undegraded":"2026-02-21T01:34:05.510574+0000","last_fullsized":"2026-02-21T01:34:05.510574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:56:36.344912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510530+0000","last_change":"2026-02-21T01:28:23.925048+0000","last_active":"2026-02-21T01:34:05.510530+0000","last_peered":"2026-02-21T01:34:05.510530+0000","last_clean":"2026-02-21T01:34:05.510530+0000","last_became_active":"2026-02-21T01:28:23.916467+0000","last_became_peered":"2026-02-21T01:28:23.916467+0000","last_unstale":"2026-02-21T01:34:05.510530+0000","last_undegraded":"2026-02-21T01:34:05.510530+0000","last_fullsized":"2026-02-21T01:34:05.510530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:59.497146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510414+0000","last_change":"2026-02-21T01:28:23.918503+0000","last_active":"2026-02-21T01:34:05.510414+0000","last_peered":"2026-02-21T01:34:05.510414+0000","last_clean":"2026-02-21T01:34:05.510414+0000","last_became_active":"2026-02-21T01:28:23.916777+0000","last_became_peered":"2026-02-21T01:28:23.916777+0000","last_unstale":"2026-02-21T01:34:05.510414+0000","last_undegraded":"2026-02-21T01:34:05.510414+0000","last_fullsized":"2026-02-21T01:34:05.510414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:50:28.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":595,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512361+0000","last_change":"2026-02-21T01:28:23.895892+0000","last_active":"2026-02-21T01:34:05.512361+0000","last_peered":"2026-02-21T01:34:05.512361+0000","last_clean":"2026-02-21T01:34:05.512361+0000","last_became_active":"2026-02-21T01:28:23.895201+0000","last_became_peered":"2026-02-21T01:28:23.895201+0000","last_unstale":"2026-02-21T01:34:05.512361+0000","last_undegraded":"2026-02-21T01:34:05.512361+0000","last_fullsized":"2026-02-21T01:34:05.512361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:21:32.687664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431794+0000","last_change":"2026-02-21T01:28:23.890053+0000","last_active":"2026-02-21T01:34:04.431794+0000","last_peered":"2026-02-21T01:34:04.431794+0000","last_clean":"2026-02-21T01:34:04.431794+0000","last_became_active":"2026-02-21T01:28:23.886126+0000","last_became_peered":"2026-02-21T01:28:23.886126+0000","last_unstale":"2026-02-21T01:34:04.431794+0000","last_undegraded":"2026-02-21T01:34:04.431794+0000","last_fullsized":"2026-02-21T01:34:04.431794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:16:07.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":5814,"kb_used_meta":57225,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5954498,"internal_metadata":58598462},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640346,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":8625,"kb_used_meta":54414,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8832023,"internal_metadata":55720937},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640346,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68656,"kb_used_data":5600,"kb_used_omap":205,"kb_used_meta":62834,"kb_avail":94303184,"statfs":{"total":96636764160,"available":96566460416,"internally_reserved":0,"allocated":5734400,"data_stored":2918814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210051,"internal_metadata":64342909},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640345,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68136,"kb_used_data":5080,"kb_used_omap":5681,"kb_used_meta":57358,"kb_avail":94303704,"statfs":{"total":96636764160,"available":96566992896,"internally_reserved":0,"allocated":5201920,"data_stored":2389886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5818260,"internal_metadata":58734700},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640345,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50092,"kb_used_data":5084,"kb_used_omap":201,"kb_used_meta":44790,"kb_avail":94321748,"statfs":{"total":96636764160,"available":96585469952,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":206623,"internal_metadata":45865185},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640345,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68660,"kb_used_data":5604,"kb_used_omap":3005,"kb_used_meta":60034,"kb_avail":94303180,"statfs":{"total":96636764160,"available":96566456320,"internally_reserved":0,"allocated":5738496,"data_stored":2918819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3077548,"internal_metadata":61475412},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:35:09.328 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-21T01:35:09.328 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:35:09.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.392+0000 7ff09af4c640 10 monclient: get_monmap_and_config 2026-02-21T01:35:09.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.392+0000 7ff09af4c640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.392+0000 7ff09af4c640 10 monclient: monmap: 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:09.393647+0000 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:09.393647+0000 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:09.394 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.392+0000 7ff09af4c640 1 Processor -- start 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.392+0000 7ff09af4c640 1 -- start start 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.392+0000 7ff09af4c640 10 monclient: init 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient(hunting): picked mon.noname-a con 0x7ff0940901a0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient(hunting): picked mon.noname-b con 0x7ff094090e20 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient(hunting): picked mon.noname-c con 0x7ff094057400 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.404 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff094090570 con 0x7ff0940901a0 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0940882a0 con 0x7ff094057400 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09408c9b0 con 0x7ff094090e20 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient(hunting): authenticate will time out at 1041.099110s 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff098cc1640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff0940901a0 0x7ff09408bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33144/0 (socket says 10.20.193.43:33144) 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff098cc1640 1 -- 10.20.193.43:0/3741841387 learned_addr learned my addr 10.20.193.43:0/3741841387 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099677029 0 0) 0x7ff094090570 con 0x7ff0940901a0 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.405 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): my global_id is 25182 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff080003610 con 0x7ff0940901a0 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185425345 0 0) 0x7ff09408c9b0 con 0x7ff094090e20 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient(hunting): my global_id is 104144 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff094090570 con 0x7ff094090e20 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 423239384 0 0) 0x7ff080003610 con 0x7ff0940901a0 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 >> v1:10.20.193.43:6790/0 conn(0x7ff094090e20 legacy=0x7ff09408c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 >> v1:10.20.193.46:6789/0 conn(0x7ff094057400 legacy=0x7ff0941a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.406 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 monclient: found mon.noname-a 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff094056fe0 con 0x7ff0940901a0 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff084002df0 con 0x7ff0940901a0 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 5 monclient: authenticate success, global_id 25182 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: dump: 2026-02-21T01:35:09.407 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff084002f90 con 0x7ff0940901a0 2026-02-21T01:35:09.408 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 1 -- 10.20.193.43:0/3741841387 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff0840033d0 con 0x7ff0940901a0 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff08b7fe640 10 monclient: dump: 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.409 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.393+0000 7ff09af4c640 4 set_mon_vals no callback set 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient: shutdown 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- 10.20.193.43:0/3741841387 >> v1:10.20.193.43:6789/0 conn(0x7ff0940901a0 legacy=0x7ff09408bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- 10.20.193.43:0/3741841387 shutdown_connections 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- 10.20.193.43:0/3741841387 >> 10.20.193.43:0/3741841387 conn(0x7ff09408dd90 msgr2=0x7ff09408e190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- 10.20.193.43:0/3741841387 shutdown_connections 2026-02-21T01:35:09.410 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- 10.20.193.43:0/3741841387 wait complete. 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient: monmap: 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.411 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 librados: starting msgr at 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 librados: starting objecter 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 Processor -- start 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- start start 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 librados: setting wanted keys 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 librados: calling monclient init 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient: init 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.412 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient(hunting): picked mon.noname-c con 0x7ff094057400 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient(hunting): picked mon.noname-a con 0x7ff0940901a0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient(hunting): picked mon.noname-b con 0x7ff094090e20 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0941d6e40 con 0x7ff0940901a0 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09408b3b0 con 0x7ff094090e20 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff094088480 con 0x7ff094057400 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff09af4c640 10 monclient(hunting): authenticate will time out at 1041.100967s 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff098cc1640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff094057400 0x7ff0941d6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58414/0 (socket says 10.20.193.43:58414) 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff098cc1640 1 -- 10.20.193.43:0/3253838177 learned_addr learned my addr 10.20.193.43:0/3253838177 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.394+0000 7ff08bfff640 1 --1- 10.20.193.43:0/3253838177 >> v1:10.20.193.43:6789/0 conn(0x7ff0940901a0 0x7ff0941d6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33158/0 (socket says 10.20.193.43:33158) 2026-02-21T01:35:09.413 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 client.?.objecter ms_handle_connect 0x7ff094057400 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 client.?.objecter ms_handle_connect 0x7ff0940901a0 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484943598 0 0) 0x7ff094088480 con 0x7ff094057400 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): my global_id is 104147 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff064003610 con 0x7ff094057400 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493172574 0 0) 0x7ff0941d6e40 con 0x7ff0940901a0 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.414 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): my global_id is 25185 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff094088480 con 0x7ff0940901a0 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3988505305 0 0) 0x7ff064003610 con 0x7ff094057400 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0941d6e40 con 0x7ff094057400 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff0840032e0 con 0x7ff094057400 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): dump: 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.415 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3213725875 0 0) 0x7ff094088480 con 0x7ff0940901a0 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff064003610 con 0x7ff0940901a0 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff07c003060 con 0x7ff0940901a0 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:09.416 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient(hunting): dump: 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.417 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 client.?.objecter ms_handle_connect 0x7ff094090e20 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2803602196 0 0) 0x7ff0941d6e40 con 0x7ff094057400 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 >> v1:10.20.193.46:6789/0 conn(0x7ff094090e20 legacy=0x7ff0942385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 >> v1:10.20.193.43:6789/0 conn(0x7ff0940901a0 legacy=0x7ff0941d6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 monclient: found mon.c 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0941aa910 con 0x7ff094057400 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.418 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 5 monclient: authenticate success, global_id 104147 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 monclient: _renew_subs 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0941aa630 con 0x7ff094057400 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 client.104147.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 monclient: _renew_subs 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0941ab080 con 0x7ff094057400 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 1 librados: init done 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff084002f70 con 0x7ff094057400 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.419 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff084004b80 con 0x7ff094057400 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 10 monclient: dump: 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.420 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff08affd640 4 set_mon_vals no callback set 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0940008d0 con 0x7ff094057400 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.395+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff084004d20 con 0x7ff094057400 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.396+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7ff08404e060 con 0x7ff094057400 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.396+0000 7ff0897fa640 10 client.104147.objecter ms_dispatch2 0x7ff094000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.396+0000 7ff0897fa640 3 client.104147.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.396+0000 7ff0897fa640 3 client.104147.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:09.421 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.396+0000 7ff0897fa640 20 client.104147.objecter dump_active .. 0 homeless 2026-02-21T01:35:09.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.396+0000 7ff08bfff640 10 monclient: get_auth_request con 0x7ff06403ea30 auth_method 0 2026-02-21T01:35:09.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.396+0000 7ff0897fa640 10 client.104147.objecter ms_handle_connect 0x7ff06403ea30 2026-02-21T01:35:09.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.398+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff084017680 con 0x7ff094057400 2026-02-21T01:35:09.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.398+0000 7ff0897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.422 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.398+0000 7ff0897fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:09.505 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.504+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0941a31e0 con 0x7ff06403ea30 2026-02-21T01:35:09.506 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.505+0000 7ff0897fa640 1 -- 10.20.193.43:0/3253838177 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114080 (unknown 2965378022 0 2561535979) 0x7ff0941a31e0 con 0x7ff06403ea30 2026-02-21T01:35:09.507 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:35:09.507 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 10 librados: watch_flush enter 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 10 librados: watch_flush exit 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 20 client.104147.objecter shutdown clearing up homeless session... 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 10 client.104147.objecter successfully canceled tick 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 >> v1:10.20.193.46:6812/860801619 conn(0x7ff06403ea30 legacy=0x7ff06405eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 10 monclient: shutdown 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 >> v1:10.20.193.43:6790/0 conn(0x7ff094057400 legacy=0x7ff0941d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 shutdown_connections 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.506+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 >> 10.20.193.43:0/3253838177 conn(0x7ff09408dd90 msgr2=0x7ff094085de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.507+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 shutdown_connections 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.507+0000 7ff09af4c640 1 -- 10.20.193.43:0/3253838177 wait complete. 2026-02-21T01:35:09.508 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.507+0000 7ff09af4c640 1 librados: shutdown 2026-02-21T01:35:09.516 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":536,"stamp":"2026-02-21T01:35:08.666106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":391824,"kb_used_data":31536,"kb_used_omap":23534,"kb_used_meta":336657,"kb_avail":565839216,"statfs":{"total":579820584960,"available":579419357184,"internally_reserved":0,"allocated":32292864,"data_stored":15397220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24099003,"internal_metadata":344737605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001205"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429993+0000","last_change":"2026-02-21T01:28:23.945241+0000","last_active":"2026-02-21T01:34:04.429993+0000","last_peered":"2026-02-21T01:34:04.429993+0000","last_clean":"2026-02-21T01:34:04.429993+0000","last_became_active":"2026-02-21T01:28:23.922684+0000","last_became_peered":"2026-02-21T01:28:23.922684+0000","last_unstale":"2026-02-21T01:34:04.429993+0000","last_undegraded":"2026-02-21T01:34:04.429993+0000","last_fullsized":"2026-02-21T01:34:04.429993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.725896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510194+0000","last_change":"2026-02-21T01:28:23.903534+0000","last_active":"2026-02-21T01:34:05.510194+0000","last_peered":"2026-02-21T01:34:05.510194+0000","last_clean":"2026-02-21T01:34:05.510194+0000","last_became_active":"2026-02-21T01:28:23.901014+0000","last_became_peered":"2026-02-21T01:28:23.901014+0000","last_unstale":"2026-02-21T01:34:05.510194+0000","last_undegraded":"2026-02-21T01:34:05.510194+0000","last_fullsized":"2026-02-21T01:34:05.510194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510216+0000","last_change":"2026-02-21T01:28:23.915336+0000","last_active":"2026-02-21T01:34:05.510216+0000","last_peered":"2026-02-21T01:34:05.510216+0000","last_clean":"2026-02-21T01:34:05.510216+0000","last_became_active":"2026-02-21T01:28:23.899839+0000","last_became_peered":"2026-02-21T01:28:23.899839+0000","last_unstale":"2026-02-21T01:34:05.510216+0000","last_undegraded":"2026-02-21T01:34:05.510216+0000","last_fullsized":"2026-02-21T01:34:05.510216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:21.620145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429956+0000","last_change":"2026-02-21T01:28:23.941012+0000","last_active":"2026-02-21T01:34:04.429956+0000","last_peered":"2026-02-21T01:34:04.429956+0000","last_clean":"2026-02-21T01:34:04.429956+0000","last_became_active":"2026-02-21T01:28:23.922704+0000","last_became_peered":"2026-02-21T01:28:23.922704+0000","last_unstale":"2026-02-21T01:34:04.429956+0000","last_undegraded":"2026-02-21T01:34:04.429956+0000","last_fullsized":"2026-02-21T01:34:04.429956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:59:39.930589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431997+0000","last_change":"2026-02-21T01:28:23.891399+0000","last_active":"2026-02-21T01:34:04.431997+0000","last_peered":"2026-02-21T01:34:04.431997+0000","last_clean":"2026-02-21T01:34:04.431997+0000","last_became_active":"2026-02-21T01:28:23.888345+0000","last_became_peered":"2026-02-21T01:28:23.888345+0000","last_unstale":"2026-02-21T01:34:04.431997+0000","last_undegraded":"2026-02-21T01:34:04.431997+0000","last_fullsized":"2026-02-21T01:34:04.431997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:03:38.993396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":602,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510784+0000","last_change":"2026-02-21T01:28:23.902177+0000","last_active":"2026-02-21T01:34:05.510784+0000","last_peered":"2026-02-21T01:34:05.510784+0000","last_clean":"2026-02-21T01:34:05.510784+0000","last_became_active":"2026-02-21T01:28:23.900280+0000","last_became_peered":"2026-02-21T01:28:23.900280+0000","last_unstale":"2026-02-21T01:34:05.510784+0000","last_undegraded":"2026-02-21T01:34:05.510784+0000","last_fullsized":"2026-02-21T01:34:05.510784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:30:10.284746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510674+0000","last_change":"2026-02-21T01:28:23.922714+0000","last_active":"2026-02-21T01:34:05.510674+0000","last_peered":"2026-02-21T01:34:05.510674+0000","last_clean":"2026-02-21T01:34:05.510674+0000","last_became_active":"2026-02-21T01:28:23.915403+0000","last_became_peered":"2026-02-21T01:28:23.915403+0000","last_unstale":"2026-02-21T01:34:05.510674+0000","last_undegraded":"2026-02-21T01:34:05.510674+0000","last_fullsized":"2026-02-21T01:34:05.510674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:16:45.257976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510399+0000","last_change":"2026-02-21T01:28:23.913408+0000","last_active":"2026-02-21T01:34:05.510399+0000","last_peered":"2026-02-21T01:34:05.510399+0000","last_clean":"2026-02-21T01:34:05.510399+0000","last_became_active":"2026-02-21T01:28:23.912821+0000","last_became_peered":"2026-02-21T01:28:23.912821+0000","last_unstale":"2026-02-21T01:34:05.510399+0000","last_undegraded":"2026-02-21T01:34:05.510399+0000","last_fullsized":"2026-02-21T01:34:05.510399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:13:33.758245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429984+0000","last_change":"2026-02-21T01:28:23.959484+0000","last_active":"2026-02-21T01:34:04.429984+0000","last_peered":"2026-02-21T01:34:04.429984+0000","last_clean":"2026-02-21T01:34:04.429984+0000","last_became_active":"2026-02-21T01:28:23.953780+0000","last_became_peered":"2026-02-21T01:28:23.953780+0000","last_unstale":"2026-02-21T01:34:04.429984+0000","last_undegraded":"2026-02-21T01:34:04.429984+0000","last_fullsized":"2026-02-21T01:34:04.429984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:09:52.644681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431341+0000","last_change":"2026-02-21T01:28:23.922395+0000","last_active":"2026-02-21T01:34:04.431341+0000","last_peered":"2026-02-21T01:34:04.431341+0000","last_clean":"2026-02-21T01:34:04.431341+0000","last_became_active":"2026-02-21T01:28:23.921588+0000","last_became_peered":"2026-02-21T01:28:23.921588+0000","last_unstale":"2026-02-21T01:34:04.431341+0000","last_undegraded":"2026-02-21T01:34:04.431341+0000","last_fullsized":"2026-02-21T01:34:04.431341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:18:14.248475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510230+0000","last_change":"2026-02-21T01:28:23.919446+0000","last_active":"2026-02-21T01:34:05.510230+0000","last_peered":"2026-02-21T01:34:05.510230+0000","last_clean":"2026-02-21T01:34:05.510230+0000","last_became_active":"2026-02-21T01:28:23.915407+0000","last_became_peered":"2026-02-21T01:28:23.915407+0000","last_unstale":"2026-02-21T01:34:05.510230+0000","last_undegraded":"2026-02-21T01:34:05.510230+0000","last_fullsized":"2026-02-21T01:34:05.510230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T08:19:21.219982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510438+0000","last_change":"2026-02-21T01:28:23.922558+0000","last_active":"2026-02-21T01:34:05.510438+0000","last_peered":"2026-02-21T01:34:05.510438+0000","last_clean":"2026-02-21T01:34:05.510438+0000","last_became_active":"2026-02-21T01:28:23.913824+0000","last_became_peered":"2026-02-21T01:28:23.913824+0000","last_unstale":"2026-02-21T01:34:05.510438+0000","last_undegraded":"2026-02-21T01:34:05.510438+0000","last_fullsized":"2026-02-21T01:34:05.510438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:11.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511918+0000","last_change":"2026-02-21T01:28:23.941204+0000","last_active":"2026-02-21T01:34:05.511918+0000","last_peered":"2026-02-21T01:34:05.511918+0000","last_clean":"2026-02-21T01:34:05.511918+0000","last_became_active":"2026-02-21T01:28:23.938182+0000","last_became_peered":"2026-02-21T01:28:23.938182+0000","last_unstale":"2026-02-21T01:34:05.511918+0000","last_undegraded":"2026-02-21T01:34:05.511918+0000","last_fullsized":"2026-02-21T01:34:05.511918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:58:59.794230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510620+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:34:05.510620+0000","last_peered":"2026-02-21T01:34:05.510620+0000","last_clean":"2026-02-21T01:34:05.510620+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:34:05.510620+0000","last_undegraded":"2026-02-21T01:34:05.510620+0000","last_fullsized":"2026-02-21T01:34:05.510620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430078+0000","last_change":"2026-02-21T01:28:23.930558+0000","last_active":"2026-02-21T01:34:04.430078+0000","last_peered":"2026-02-21T01:34:04.430078+0000","last_clean":"2026-02-21T01:34:04.430078+0000","last_became_active":"2026-02-21T01:28:23.915990+0000","last_became_peered":"2026-02-21T01:28:23.915990+0000","last_unstale":"2026-02-21T01:34:04.430078+0000","last_undegraded":"2026-02-21T01:34:04.430078+0000","last_fullsized":"2026-02-21T01:34:04.430078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:07:49.065119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510797+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:34:05.510797+0000","last_peered":"2026-02-21T01:34:05.510797+0000","last_clean":"2026-02-21T01:34:05.510797+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:34:05.510797+0000","last_undegraded":"2026-02-21T01:34:05.510797+0000","last_fullsized":"2026-02-21T01:34:05.510797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432400+0000","last_change":"2026-02-21T01:28:23.871764+0000","last_active":"2026-02-21T01:34:04.432400+0000","last_peered":"2026-02-21T01:34:04.432400+0000","last_clean":"2026-02-21T01:34:04.432400+0000","last_became_active":"2026-02-21T01:28:23.869997+0000","last_became_peered":"2026-02-21T01:28:23.869997+0000","last_unstale":"2026-02-21T01:34:04.432400+0000","last_undegraded":"2026-02-21T01:34:04.432400+0000","last_fullsized":"2026-02-21T01:34:04.432400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:28:18.194059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510519+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:34:05.510519+0000","last_peered":"2026-02-21T01:34:05.510519+0000","last_clean":"2026-02-21T01:34:05.510519+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:34:05.510519+0000","last_undegraded":"2026-02-21T01:34:05.510519+0000","last_fullsized":"2026-02-21T01:34:05.510519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"22'11","reported_seq":622,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510740+0000","last_change":"2026-02-21T01:28:23.890310+0000","last_active":"2026-02-21T01:34:05.510740+0000","last_peered":"2026-02-21T01:34:05.510740+0000","last_clean":"2026-02-21T01:34:05.510740+0000","last_became_active":"2026-02-21T01:28:23.889305+0000","last_became_peered":"2026-02-21T01:28:23.889305+0000","last_unstale":"2026-02-21T01:34:05.510740+0000","last_undegraded":"2026-02-21T01:34:05.510740+0000","last_fullsized":"2026-02-21T01:34:05.510740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:40.956411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510721+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:34:05.510721+0000","last_peered":"2026-02-21T01:34:05.510721+0000","last_clean":"2026-02-21T01:34:05.510721+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:34:05.510721+0000","last_undegraded":"2026-02-21T01:34:05.510721+0000","last_fullsized":"2026-02-21T01:34:05.510721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":608,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510617+0000","last_change":"2026-02-21T01:28:23.930311+0000","last_active":"2026-02-21T01:34:05.510617+0000","last_peered":"2026-02-21T01:34:05.510617+0000","last_clean":"2026-02-21T01:34:05.510617+0000","last_became_active":"2026-02-21T01:28:23.924669+0000","last_became_peered":"2026-02-21T01:28:23.924669+0000","last_unstale":"2026-02-21T01:34:05.510617+0000","last_undegraded":"2026-02-21T01:34:05.510617+0000","last_fullsized":"2026-02-21T01:34:05.510617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:46:07.181375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":614,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431472+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:34:04.431472+0000","last_peered":"2026-02-21T01:34:04.431472+0000","last_clean":"2026-02-21T01:34:04.431472+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:34:04.431472+0000","last_undegraded":"2026-02-21T01:34:04.431472+0000","last_fullsized":"2026-02-21T01:34:04.431472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430071+0000","last_change":"2026-02-21T01:28:23.933934+0000","last_active":"2026-02-21T01:34:04.430071+0000","last_peered":"2026-02-21T01:34:04.430071+0000","last_clean":"2026-02-21T01:34:04.430071+0000","last_became_active":"2026-02-21T01:28:23.926401+0000","last_became_peered":"2026-02-21T01:28:23.926401+0000","last_unstale":"2026-02-21T01:34:04.430071+0000","last_undegraded":"2026-02-21T01:34:04.430071+0000","last_fullsized":"2026-02-21T01:34:04.430071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:40:24.787719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512684+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:34:05.512684+0000","last_peered":"2026-02-21T01:34:05.512684+0000","last_clean":"2026-02-21T01:34:05.512684+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:34:05.512684+0000","last_undegraded":"2026-02-21T01:34:05.512684+0000","last_fullsized":"2026-02-21T01:34:05.512684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512312+0000","last_change":"2026-02-21T01:28:23.920345+0000","last_active":"2026-02-21T01:34:05.512312+0000","last_peered":"2026-02-21T01:34:05.512312+0000","last_clean":"2026-02-21T01:34:05.512312+0000","last_became_active":"2026-02-21T01:28:23.914843+0000","last_became_peered":"2026-02-21T01:28:23.914843+0000","last_unstale":"2026-02-21T01:34:05.512312+0000","last_undegraded":"2026-02-21T01:34:05.512312+0000","last_fullsized":"2026-02-21T01:34:05.512312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:01:52.859059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510234+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:34:05.510234+0000","last_peered":"2026-02-21T01:34:05.510234+0000","last_clean":"2026-02-21T01:34:05.510234+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:34:05.510234+0000","last_undegraded":"2026-02-21T01:34:05.510234+0000","last_fullsized":"2026-02-21T01:34:05.510234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430076+0000","last_change":"2026-02-21T01:28:23.920796+0000","last_active":"2026-02-21T01:34:04.430076+0000","last_peered":"2026-02-21T01:34:04.430076+0000","last_clean":"2026-02-21T01:34:04.430076+0000","last_became_active":"2026-02-21T01:28:23.915656+0000","last_became_peered":"2026-02-21T01:28:23.915656+0000","last_unstale":"2026-02-21T01:34:04.430076+0000","last_undegraded":"2026-02-21T01:34:04.430076+0000","last_fullsized":"2026-02-21T01:34:04.430076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:51:20.257392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432963+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:34:04.432963+0000","last_peered":"2026-02-21T01:34:04.432963+0000","last_clean":"2026-02-21T01:34:04.432963+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:34:04.432963+0000","last_undegraded":"2026-02-21T01:34:04.432963+0000","last_fullsized":"2026-02-21T01:34:04.432963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":760,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510225+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:34:05.510225+0000","last_peered":"2026-02-21T01:34:05.510225+0000","last_clean":"2026-02-21T01:34:05.510225+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:34:05.510225+0000","last_undegraded":"2026-02-21T01:34:05.510225+0000","last_fullsized":"2026-02-21T01:34:05.510225+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510521+0000","last_change":"2026-02-21T01:28:23.888153+0000","last_active":"2026-02-21T01:34:05.510521+0000","last_peered":"2026-02-21T01:34:05.510521+0000","last_clean":"2026-02-21T01:34:05.510521+0000","last_became_active":"2026-02-21T01:28:23.886858+0000","last_became_peered":"2026-02-21T01:28:23.886858+0000","last_unstale":"2026-02-21T01:34:05.510521+0000","last_undegraded":"2026-02-21T01:34:05.510521+0000","last_fullsized":"2026-02-21T01:34:05.510521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:00:16.121993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":595,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512458+0000","last_change":"2026-02-21T01:28:23.902882+0000","last_active":"2026-02-21T01:34:05.512458+0000","last_peered":"2026-02-21T01:34:05.512458+0000","last_clean":"2026-02-21T01:34:05.512458+0000","last_became_active":"2026-02-21T01:28:23.897729+0000","last_became_peered":"2026-02-21T01:28:23.897729+0000","last_unstale":"2026-02-21T01:34:05.512458+0000","last_undegraded":"2026-02-21T01:34:05.512458+0000","last_fullsized":"2026-02-21T01:34:05.512458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:54:58.723961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511931+0000","last_change":"2026-02-21T01:28:23.915267+0000","last_active":"2026-02-21T01:34:05.511931+0000","last_peered":"2026-02-21T01:34:05.511931+0000","last_clean":"2026-02-21T01:34:05.511931+0000","last_became_active":"2026-02-21T01:28:23.914559+0000","last_became_peered":"2026-02-21T01:28:23.914559+0000","last_unstale":"2026-02-21T01:34:05.511931+0000","last_undegraded":"2026-02-21T01:34:05.511931+0000","last_fullsized":"2026-02-21T01:34:05.511931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:50:14.365478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430087+0000","last_change":"2026-02-21T01:28:23.915431+0000","last_active":"2026-02-21T01:34:04.430087+0000","last_peered":"2026-02-21T01:34:04.430087+0000","last_clean":"2026-02-21T01:34:04.430087+0000","last_became_active":"2026-02-21T01:28:23.912391+0000","last_became_peered":"2026-02-21T01:28:23.912391+0000","last_unstale":"2026-02-21T01:34:04.430087+0000","last_undegraded":"2026-02-21T01:34:04.430087+0000","last_fullsized":"2026-02-21T01:34:04.430087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:02:54.959438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511153+0000","last_change":"2026-02-21T01:28:23.934029+0000","last_active":"2026-02-21T01:34:05.511153+0000","last_peered":"2026-02-21T01:34:05.511153+0000","last_clean":"2026-02-21T01:34:05.511153+0000","last_became_active":"2026-02-21T01:28:23.930449+0000","last_became_peered":"2026-02-21T01:28:23.930449+0000","last_unstale":"2026-02-21T01:34:05.511153+0000","last_undegraded":"2026-02-21T01:34:05.511153+0000","last_fullsized":"2026-02-21T01:34:05.511153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:48:42.258342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430005+0000","last_change":"2026-02-21T01:28:23.931187+0000","last_active":"2026-02-21T01:34:04.430005+0000","last_peered":"2026-02-21T01:34:04.430005+0000","last_clean":"2026-02-21T01:34:04.430005+0000","last_became_active":"2026-02-21T01:28:23.921627+0000","last_became_peered":"2026-02-21T01:28:23.921627+0000","last_unstale":"2026-02-21T01:34:04.430005+0000","last_undegraded":"2026-02-21T01:34:04.430005+0000","last_fullsized":"2026-02-21T01:34:04.430005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:50:18.522770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511401+0000","last_change":"2026-02-21T01:28:23.945564+0000","last_active":"2026-02-21T01:34:05.511401+0000","last_peered":"2026-02-21T01:34:05.511401+0000","last_clean":"2026-02-21T01:34:05.511401+0000","last_became_active":"2026-02-21T01:28:23.945129+0000","last_became_peered":"2026-02-21T01:28:23.945129+0000","last_unstale":"2026-02-21T01:34:05.511401+0000","last_undegraded":"2026-02-21T01:34:05.511401+0000","last_fullsized":"2026-02-21T01:34:05.511401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:41:28.842721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510574+0000","last_change":"2026-02-21T01:28:23.881341+0000","last_active":"2026-02-21T01:34:05.510574+0000","last_peered":"2026-02-21T01:34:05.510574+0000","last_clean":"2026-02-21T01:34:05.510574+0000","last_became_active":"2026-02-21T01:28:23.880056+0000","last_became_peered":"2026-02-21T01:28:23.880056+0000","last_unstale":"2026-02-21T01:34:05.510574+0000","last_undegraded":"2026-02-21T01:34:05.510574+0000","last_fullsized":"2026-02-21T01:34:05.510574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:56:36.344912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510530+0000","last_change":"2026-02-21T01:28:23.925048+0000","last_active":"2026-02-21T01:34:05.510530+0000","last_peered":"2026-02-21T01:34:05.510530+0000","last_clean":"2026-02-21T01:34:05.510530+0000","last_became_active":"2026-02-21T01:28:23.916467+0000","last_became_peered":"2026-02-21T01:28:23.916467+0000","last_unstale":"2026-02-21T01:34:05.510530+0000","last_undegraded":"2026-02-21T01:34:05.510530+0000","last_fullsized":"2026-02-21T01:34:05.510530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:59.497146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510414+0000","last_change":"2026-02-21T01:28:23.918503+0000","last_active":"2026-02-21T01:34:05.510414+0000","last_peered":"2026-02-21T01:34:05.510414+0000","last_clean":"2026-02-21T01:34:05.510414+0000","last_became_active":"2026-02-21T01:28:23.916777+0000","last_became_peered":"2026-02-21T01:28:23.916777+0000","last_unstale":"2026-02-21T01:34:05.510414+0000","last_undegraded":"2026-02-21T01:34:05.510414+0000","last_fullsized":"2026-02-21T01:34:05.510414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:50:28.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":595,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512361+0000","last_change":"2026-02-21T01:28:23.895892+0000","last_active":"2026-02-21T01:34:05.512361+0000","last_peered":"2026-02-21T01:34:05.512361+0000","last_clean":"2026-02-21T01:34:05.512361+0000","last_became_active":"2026-02-21T01:28:23.895201+0000","last_became_peered":"2026-02-21T01:28:23.895201+0000","last_unstale":"2026-02-21T01:34:05.512361+0000","last_undegraded":"2026-02-21T01:34:05.512361+0000","last_fullsized":"2026-02-21T01:34:05.512361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:21:32.687664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431794+0000","last_change":"2026-02-21T01:28:23.890053+0000","last_active":"2026-02-21T01:34:04.431794+0000","last_peered":"2026-02-21T01:34:04.431794+0000","last_clean":"2026-02-21T01:34:04.431794+0000","last_became_active":"2026-02-21T01:28:23.886126+0000","last_became_peered":"2026-02-21T01:28:23.886126+0000","last_unstale":"2026-02-21T01:34:04.431794+0000","last_undegraded":"2026-02-21T01:34:04.431794+0000","last_fullsized":"2026-02-21T01:34:04.431794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:16:07.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":5814,"kb_used_meta":57225,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5954498,"internal_metadata":58598462},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640346,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":8625,"kb_used_meta":54414,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8832023,"internal_metadata":55720937},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640346,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68656,"kb_used_data":5600,"kb_used_omap":205,"kb_used_meta":62834,"kb_avail":94303184,"statfs":{"total":96636764160,"available":96566460416,"internally_reserved":0,"allocated":5734400,"data_stored":2918814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210051,"internal_metadata":64342909},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640345,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68136,"kb_used_data":5080,"kb_used_omap":5681,"kb_used_meta":57358,"kb_avail":94303704,"statfs":{"total":96636764160,"available":96566992896,"internally_reserved":0,"allocated":5201920,"data_stored":2389886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5818260,"internal_metadata":58734700},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640345,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50092,"kb_used_data":5084,"kb_used_omap":201,"kb_used_meta":44790,"kb_avail":94321748,"statfs":{"total":96636764160,"available":96585469952,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":206623,"internal_metadata":45865185},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640345,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68660,"kb_used_data":5604,"kb_used_omap":3005,"kb_used_meta":60034,"kb_avail":94303180,"statfs":{"total":96636764160,"available":96566456320,"internally_reserved":0,"allocated":5738496,"data_stored":2918819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3077548,"internal_metadata":61475412},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:35:09.519 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-21T01:35:09.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.586+0000 7ff9c55b3640 10 monclient: get_monmap_and_config 2026-02-21T01:35:09.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.586+0000 7ff9c55b3640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.596 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.586+0000 7ff9c55b3640 10 monclient: monmap: 2026-02-21T01:35:09.596 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.596 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:09.588216+0000 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:09.588216+0000 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 1 Processor -- start 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 1 -- start start 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient: init 2026-02-21T01:35:09.597 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient(hunting): picked mon.noname-b con 0x7ff9c008ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient(hunting): picked mon.noname-a con 0x7ff9c008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient(hunting): picked mon.noname-c con 0x7ff9c008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c008a690 con 0x7ff9c008d4d0 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c008b910 con 0x7ff9c008d8d0 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c0088ae0 con 0x7ff9c008ddb0 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9c55b3640 10 monclient(hunting): authenticate will time out at 1041.293653s 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9beffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff9c008ddb0 0x7ff9c008e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58422/0 (socket says 10.20.193.43:58422) 2026-02-21T01:35:09.598 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9beffd640 1 -- 10.20.193.43:0/1625443704 learned_addr learned my addr 10.20.193.43:0/1625443704 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9be7fc640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff9c008d4d0 0x7ff9c017e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33170/0 (socket says 10.20.193.43:33170) 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412673281 0 0) 0x7ff9c008a690 con 0x7ff9c008d4d0 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): my global_id is 25188 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9ac003610 con 0x7ff9c008d4d0 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587363878 0 0) 0x7ff9c0088ae0 con 0x7ff9c008ddb0 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.599 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 10 monclient(hunting): my global_id is 104150 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.587+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c008a690 con 0x7ff9c008ddb0 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1318488712 0 0) 0x7ff9ac003610 con 0x7ff9c008d4d0 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 >> v1:10.20.193.43:6790/0 conn(0x7ff9c008ddb0 legacy=0x7ff9c008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 >> v1:10.20.193.46:6789/0 conn(0x7ff9c008d8d0 legacy=0x7ff9c019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 monclient: found mon.noname-a 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c01a3ef0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.600 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff9a8002df0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 5 monclient: authenticate success, global_id 25188 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: dump: 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.601 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9a80030f0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 4 set_mon_vals no callback set 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 1 -- 10.20.193.43:0/1625443704 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff9a8003530 con 0x7ff9c008d4d0 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.602 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9bdffb640 10 monclient: dump: 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 10 monclient: shutdown 2026-02-21T01:35:09.603 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 1 -- 10.20.193.43:0/1625443704 >> v1:10.20.193.43:6789/0 conn(0x7ff9c008d4d0 legacy=0x7ff9c017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 1 -- 10.20.193.43:0/1625443704 shutdown_connections 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 1 -- 10.20.193.43:0/1625443704 >> 10.20.193.43:0/1625443704 conn(0x7ff9c008f480 msgr2=0x7ff9c008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 1 -- 10.20.193.43:0/1625443704 shutdown_connections 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 1 -- 10.20.193.43:0/1625443704 wait complete. 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 10 monclient: build_initial_monmap 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 10 monclient: monmap: 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:09.604 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 1 librados: starting msgr at 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.588+0000 7ff9c55b3640 1 librados: starting objecter 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 Processor -- start 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 -- start start 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 librados: setting wanted keys 2026-02-21T01:35:09.605 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 librados: calling monclient init 2026-02-21T01:35:09.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient: init 2026-02-21T01:35:09.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:09.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:35:09.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient(hunting): picked mon.noname-c con 0x7ff9c008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:09.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient(hunting): picked mon.noname-b con 0x7ff9c008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:09.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient(hunting): picked mon.noname-a con 0x7ff9c008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:09.606 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c013a8c0 con 0x7ff9c008ddb0 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c0125c00 con 0x7ff9c008d8d0 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c0127f60 con 0x7ff9c008d4d0 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient(hunting): authenticate will time out at 1041.295282s 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9beffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7ff9c008d4d0 0x7ff9c0124490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58430/0 (socket says 10.20.193.43:58430) 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9beffd640 1 -- 10.20.193.43:0/723118708 learned_addr learned my addr 10.20.193.43:0/723118708 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 client.?.objecter ms_handle_connect 0x7ff9c008ddb0 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 client.?.objecter ms_handle_connect 0x7ff9c008d4d0 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152436895 0 0) 0x7ff9c0127f60 con 0x7ff9c008d4d0 2026-02-21T01:35:09.607 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): my global_id is 104153 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff98c003610 con 0x7ff9c008d4d0 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439966663 0 0) 0x7ff9c013a8c0 con 0x7ff9c008ddb0 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): my global_id is 25191 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c0127f60 con 0x7ff9c008ddb0 2026-02-21T01:35:09.608 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 639703102 0 0) 0x7ff98c003610 con 0x7ff9c008d4d0 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9c013a8c0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff9b40030b0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): dump: 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.609 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 120270327 0 0) 0x7ff9c0127f60 con 0x7ff9c008ddb0 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff98c003610 con 0x7ff9c008ddb0 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff9b0003040 con 0x7ff9c008ddb0 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient(hunting): dump: 2026-02-21T01:35:09.610 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.611 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3066092303 0 0) 0x7ff9c013a8c0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 >> v1:10.20.193.46:6789/0 conn(0x7ff9c008d8d0 legacy=0x7ff9c0124ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 >> v1:10.20.193.43:6789/0 conn(0x7ff9c008ddb0 legacy=0x7ff9c019bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 monclient: found mon.c 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c01276c0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.612 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 client.?.objecter ms_handle_connect 0x7ff9c008d8d0 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 5 monclient: authenticate success, global_id 104153 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient: _renew_subs 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c0126760 con 0x7ff9c008d4d0 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 client.104153.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient: _renew_subs 2026-02-21T01:35:09.613 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9b40048d0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9c01252b0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9c55b3640 1 librados: init done 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff9b4004c20 con 0x7ff9c008d4d0 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff99f7fe640 10 monclient: dump: 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:09.614 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.589+0000 7ff9bd7fa640 4 set_mon_vals no callback set 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff9c55b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff9c55b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.615 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff9c55b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c005cfb0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff9b40115a0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7ff9b404e100 con 0x7ff9c008d4d0 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff99f7fe640 10 client.104153.objecter ms_dispatch2 0x7ff9c0000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff99f7fe640 3 client.104153.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff99f7fe640 3 client.104153.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff99f7fe640 20 client.104153.objecter dump_active .. 0 homeless 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff9be7fc640 10 monclient: get_auth_request con 0x7ff98c03e910 auth_method 0 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.590+0000 7ff99f7fe640 10 client.104153.objecter ms_handle_connect 0x7ff98c03e910 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.592+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff9b4017780 con 0x7ff9c008d4d0 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.592+0000 7ff99f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:09.616 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.592+0000 7ff99f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:09.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.700+0000 7ff9c55b3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:35:09.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.700+0000 7ff9c55b3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:35:09.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.700+0000 7ff9c55b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:09.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.700+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9c01255f0 con 0x7ff9c008d4d0 2026-02-21T01:35:09.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.700+0000 7ff99f7fe640 1 -- 10.20.193.43:0/723118708 <== mon.2 v1:10.20.193.43:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v321) ==== 74+0+13519 (unknown 3236574838 0 3807998816) 0x7ff9b4017080 con 0x7ff9c008d4d0 2026-02-21T01:35:09.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.700+0000 7ff99f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-21T01:35:09.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.700+0000 7ff99f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:09.703 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:35:09.703 INFO:teuthology.orchestra.run.trial043.stdout:{"epoch":321,"fsid":"6ad0f5d2-7471-410a-a664-22f2b680bffe","created":"2026-02-21T01:27:44.582175+0000","modified":"2026-02-21T01:34:04.428123+0000","last_up_change":"2026-02-21T01:27:48.746376+0000","last_in_change":"2026-02-21T01:27:45.744393+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":99,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-21T01:27:50.628015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-21T01:27:53.551352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-21T01:28:22.176784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e67289af-bac2-443d-83b5-4766298e9303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":318,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6800","nonce":1072173340}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6801","nonce":1072173340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6803","nonce":1072173340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6802","nonce":1072173340}]},"public_addr":"10.20.193.43:6800/1072173340","cluster_addr":"10.20.193.43:6801/1072173340","heartbeat_back_addr":"10.20.193.43:6803/1072173340","heartbeat_front_addr":"10.20.193.43:6802/1072173340","state":["exists","up"]},{"osd":1,"uuid":"4207f5e8-3ce8-4f55-bb23-a8605d56d872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":318,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6808","nonce":3522371706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6809","nonce":3522371706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6811","nonce":3522371706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6810","nonce":3522371706}]},"public_addr":"10.20.193.43:6808/3522371706","cluster_addr":"10.20.193.43:6809/3522371706","heartbeat_back_addr":"10.20.193.43:6811/3522371706","heartbeat_front_addr":"10.20.193.43:6810/3522371706","state":["exists","up"]},{"osd":2,"uuid":"da0c4995-e8bf-480e-876d-be10b4196751","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":318,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6804","nonce":3123352217}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6805","nonce":3123352217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6807","nonce":3123352217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.43:6806","nonce":3123352217}]},"public_addr":"10.20.193.43:6804/3123352217","cluster_addr":"10.20.193.43:6805/3123352217","heartbeat_back_addr":"10.20.193.43:6807/3123352217","heartbeat_front_addr":"10.20.193.43:6806/3123352217","state":["exists","up"]},{"osd":3,"uuid":"2cb6a730-2373-4354-904c-57509d260325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":318,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6808","nonce":3250452844}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6809","nonce":3250452844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6811","nonce":3250452844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6810","nonce":3250452844}]},"public_addr":"10.20.193.46:6808/3250452844","cluster_addr":"10.20.193.46:6809/3250452844","heartbeat_back_addr":"10.20.193.46:6811/3250452844","heartbeat_front_addr":"10.20.193.46:6810/3250452844","state":["exists","up"]},{"osd":4,"uuid":"22624587-71c2-4992-b8bb-6ff8f9fad066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":318,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6802","nonce":3807500891}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6804","nonce":3807500891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6807","nonce":3807500891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6806","nonce":3807500891}]},"public_addr":"10.20.193.46:6802/3807500891","cluster_addr":"10.20.193.46:6804/3807500891","heartbeat_back_addr":"10.20.193.46:6807/3807500891","heartbeat_front_addr":"10.20.193.46:6806/3807500891","state":["exists","up"]},{"osd":5,"uuid":"b7f8c29f-504c-4cfe-b959-03fe02b39f69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":318,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6800","nonce":1266691672}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6801","nonce":1266691672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6805","nonce":1266691672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.46:6803","nonce":1266691672}]},"public_addr":"10.20.193.46:6800/1266691672","cluster_addr":"10.20.193.46:6801/1266691672","heartbeat_back_addr":"10.20.193.46:6805/1266691672","heartbeat_front_addr":"10.20.193.46:6803/1266691672","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.465320+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.517324+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.541306+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.629304+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.660956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-21T01:27:47.636067+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":4}]},{"pool":14,"snaps":[{"begin":3,"length":4}]},{"pool":33,"snaps":[{"begin":1,"length":1}]},{"pool":61,"snaps":[{"begin":1,"length":1}]},{"pool":90,"snaps":[{"begin":4,"length":2},{"begin":7,"length":2}]},{"pool":100,"snaps":[{"begin":1,"length":1}]},{"pool":119,"snaps":[{"begin":1,"length":2}]},{"pool":135,"snaps":[{"begin":3,"length":1}]},{"pool":142,"snaps":[{"begin":1,"length":4}]},{"pool":148,"snaps":[{"begin":2,"length":2}]},{"pool":158,"snaps":[{"begin":2,"length":3}]},{"pool":167,"snaps":[{"begin":2,"length":4}]},{"pool":168,"snaps":[{"begin":2,"length":2}]},{"pool":179,"snaps":[{"begin":2,"length":1}]},{"pool":184,"snaps":[{"begin":2,"length":3}]},{"pool":197,"snaps":[{"begin":4,"length":1},{"begin":6,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 10 librados: watch_flush enter 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 10 librados: watch_flush exit 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 20 client.104153.objecter shutdown clearing up homeless session... 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 10 client.104153.objecter successfully canceled tick 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 >> v1:10.20.193.46:6812/860801619 conn(0x7ff98c03e910 legacy=0x7ff98c05edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 10 monclient: shutdown 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:09.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 >> v1:10.20.193.43:6790/0 conn(0x7ff9c008d4d0 legacy=0x7ff9c0124490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:09.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 shutdown_connections 2026-02-21T01:35:09.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 >> 10.20.193.43:0/723118708 conn(0x7ff9c008f480 msgr2=0x7ff9c01a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:09.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 shutdown_connections 2026-02-21T01:35:09.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 1 -- 10.20.193.43:0/723118708 wait complete. 2026-02-21T01:35:09.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:09.701+0000 7ff9c55b3640 1 librados: shutdown 2026-02-21T01:35:10.713 INFO:tasks.ceph:Scrubbing osd.0 2026-02-21T01:35:10.713 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-21T01:35:10.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.785+0000 7fc429bcf640 10 monclient: get_monmap_and_config 2026-02-21T01:35:10.797 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.785+0000 7fc429bcf640 10 monclient: build_initial_monmap 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.785+0000 7fc429bcf640 10 monclient: monmap: 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:10.787129+0000 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:10.787129+0000 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:10.798 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 1 Processor -- start 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 1 -- start start 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient: init 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient(hunting): picked mon.noname-b con 0x7fc42408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient(hunting): picked mon.noname-a con 0x7fc42408d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient(hunting): picked mon.noname-c con 0x7fc42408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc42408a690 con 0x7fc42408d4d0 2026-02-21T01:35:10.799 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc42408b910 con 0x7fc42408d8d0 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc424088ae0 con 0x7fc42408ddb0 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient(hunting): authenticate will time out at 1042.492517s 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4237fe640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fc42408ddb0 0x7fc42408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:58440/0 (socket says 10.20.193.43:58440) 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc422ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc42408d4d0 0x7fc42417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33196/0 (socket says 10.20.193.43:33196) 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4237fe640 1 -- 10.20.193.43:0/2393054560 learned_addr learned my addr 10.20.193.43:0/2393054560 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351080885 0 0) 0x7fc42408a690 con 0x7fc42408d4d0 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): my global_id is 25194 2026-02-21T01:35:10.800 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc408003610 con 0x7fc42408d4d0 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432468912 0 0) 0x7fc424088ae0 con 0x7fc42408ddb0 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient(hunting): my global_id is 104156 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc42408a690 con 0x7fc42408ddb0 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 908156178 0 0) 0x7fc408003610 con 0x7fc42408d4d0 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 >> v1:10.20.193.43:6790/0 conn(0x7fc42408ddb0 legacy=0x7fc42408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 >> v1:10.20.193.46:6789/0 conn(0x7fc42408d8d0 legacy=0x7fc42419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: _finish_hunting 0 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 monclient: found mon.noname-a 2026-02-21T01:35:10.801 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4241a3ef0 con 0x7fc42408d4d0 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: _finish_auth 0 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: _check_auth_tickets 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc414002df0 con 0x7fc42408d4d0 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 5 monclient: authenticate success, global_id 25194 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: dump: 2026-02-21T01:35:10.802 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4140030b0 con 0x7fc42408d4d0 2026-02-21T01:35:10.803 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc429bcf640 4 set_mon_vals no callback set 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 1 -- 10.20.193.43:0/2393054560 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc4140034f0 con 0x7fc42408d4d0 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.786+0000 7fc4227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc4227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc4227fc640 10 monclient: dump: 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.804 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 10 monclient: shutdown 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 -- 10.20.193.43:0/2393054560 >> v1:10.20.193.43:6789/0 conn(0x7fc42408d4d0 legacy=0x7fc42417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 -- 10.20.193.43:0/2393054560 shutdown_connections 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 -- 10.20.193.43:0/2393054560 >> 10.20.193.43:0/2393054560 conn(0x7fc42408f480 msgr2=0x7fc42408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 -- 10.20.193.43:0/2393054560 shutdown_connections 2026-02-21T01:35:10.805 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 -- 10.20.193.43:0/2393054560 wait complete. 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 10 monclient: build_initial_monmap 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 10 monclient: monmap: 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:10.806 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 librados: starting msgr at 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 librados: starting objecter 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 Processor -- start 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 -- start start 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 librados: setting wanted keys 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 1 librados: calling monclient init 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.787+0000 7fc429bcf640 10 monclient: init 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient(hunting): picked mon.noname-b con 0x7fc42408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient(hunting): picked mon.noname-a con 0x7fc42408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:10.807 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient(hunting): picked mon.noname-c con 0x7fc42408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc424108520 con 0x7fc42408d8d0 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc424109fe0 con 0x7fc42408d4d0 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc42411e5e0 con 0x7fc42408ddb0 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient(hunting): authenticate will time out at 1042.494110s 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc422ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc42408d8d0 0x7fc42411ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33208/0 (socket says 10.20.193.43:33208) 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc422ffd640 1 -- 10.20.193.43:0/2851606664 learned_addr learned my addr 10.20.193.43:0/2851606664 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 client.?.objecter ms_handle_connect 0x7fc42408d8d0 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 client.?.objecter ms_handle_connect 0x7fc42408ddb0 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:10.808 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752329647 0 0) 0x7fc42411e5e0 con 0x7fc42408ddb0 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): my global_id is 104159 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3f4003610 con 0x7fc42408ddb0 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446108021 0 0) 0x7fc424108520 con 0x7fc42408d8d0 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): my global_id is 25197 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc42411e5e0 con 0x7fc42408d8d0 2026-02-21T01:35:10.809 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 client.?.objecter ms_handle_connect 0x7fc42408d4d0 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2170696666 0 0) 0x7fc3f4003610 con 0x7fc42408ddb0 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc424108520 con 0x7fc42408ddb0 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc418003390 con 0x7fc42408ddb0 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): dump: 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.810 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3166200505 0 0) 0x7fc42411e5e0 con 0x7fc42408d8d0 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3f4003610 con 0x7fc42408d8d0 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc414002db0 con 0x7fc42408d8d0 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): dump: 2026-02-21T01:35:10.811 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956982059 0 0) 0x7fc424109fe0 con 0x7fc42408d4d0 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient(hunting): my global_id is 84391 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc42411e5e0 con 0x7fc42408d4d0 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 570722058 0 0) 0x7fc424108520 con 0x7fc42408ddb0 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 >> v1:10.20.193.46:6789/0 conn(0x7fc42408d4d0 legacy=0x7fc424149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 >> v1:10.20.193.43:6789/0 conn(0x7fc42408d8d0 legacy=0x7fc42411ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: _finish_hunting 0 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 monclient: found mon.c 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42411e7b0 con 0x7fc42408ddb0 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: _finish_auth 0 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: _check_auth_tickets 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 5 monclient: authenticate success, global_id 104159 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient: _renew_subs 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc424109080 con 0x7fc42408ddb0 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 client.104159.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient: _renew_subs 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc42418fec0 con 0x7fc42408ddb0 2026-02-21T01:35:10.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4180039f0 con 0x7fc42408ddb0 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 1 librados: init done 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc418003d80 con 0x7fc42408ddb0 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 10 monclient: dump: 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.815 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc421ffb640 4 set_mon_vals no callback set 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 client.104159.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 15 client.104159.objecter _session_command_op_assign -1 1 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 20 client.104159.objecter _get_session osd=-1 returning homeless 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 client.104159.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc4241099f0 con 0x7fc42408ddb0 2026-02-21T01:35:10.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.788+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fc418003f20 con 0x7fc42408ddb0 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7fc41804d160 con 0x7fc42408ddb0 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 client.104159.objecter ms_dispatch2 0x7fc424000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 3 client.104159.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 3 client.104159.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 client.104159.objecter checking command 1 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 20 client.104159.objecter _get_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 20 client.104159.objecter put_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 15 client.104159.objecter _session_command_op_remove -1 1 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 20 client.104159.objecter _get_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 20 client.104159.objecter get_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 15 client.104159.objecter _session_command_op_assign 0 1 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 20 client.104159.objecter put_session s=0x7fc3f4064480 osd=0 4 2026-02-21T01:35:10.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 client.104159.objecter _send_command 1 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6800/1072173340 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3f4086830 con 0x7fc3f4064b30 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 20 client.104159.objecter dump_active .. 0 homeless 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_get_version_reply(handle=1 version=321) ==== 24+0+0 (unknown 1047129514 0 0) 0x7fc41804d5b0 con 0x7fc42408ddb0 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 monclient: handle_get_version_reply finishing 1 version 321 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc422ffd640 10 monclient: get_auth_request con 0x7fc3f4064b30 auth_method 0 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc4237fe640 10 monclient: get_auth_request con 0x7fc3f403ec00 auth_method 0 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 client.104159.objecter ms_handle_connect 0x7fc3f4064b30 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 client.104159.objecter ms_handle_connect 0x7fc3f403ec00 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== osd.0 v1:10.20.193.43:6800/1072173340 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc3f4086830 con 0x7fc3f4064b30 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 client.104159.objecter ms_dispatch2 0x7fc424000b90 command_reply(tid 1: 0 ) 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 10 client.104159.objecter _finish_command 1 = system:0 2026-02-21T01:35:10.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 20 client.104159.objecter put_session s=0x7fc3f4064480 osd=0 4 2026-02-21T01:35:10.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.789+0000 7fc3fffff640 15 client.104159.objecter _session_command_op_remove 0 1 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 10 client.104159.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 15 client.104159.objecter _session_command_op_assign -1 2 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 20 client.104159.objecter _get_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 20 client.104159.objecter put_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 20 client.104159.objecter _get_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 15 client.104159.objecter _session_command_op_remove -1 2 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 20 client.104159.objecter get_session s=0x7fc3f4064480 osd=0 3 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 15 client.104159.objecter _session_command_op_assign 0 2 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 20 client.104159.objecter put_session s=0x7fc3f4064480 osd=0 4 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 10 client.104159.objecter _send_command 2 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.796+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 --> v1:10.20.193.43:6800/1072173340 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc42408edb0 con 0x7fc3f4064b30 2026-02-21T01:35:10.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc3fffff640 1 -- 10.20.193.43:0/2851606664 <== osd.0 v1:10.20.193.43:6800/1072173340 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc42408edb0 con 0x7fc3f4064b30 2026-02-21T01:35:10.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc3fffff640 10 client.104159.objecter ms_dispatch2 0x7fc424000b90 command_reply(tid 2: 0 ) 2026-02-21T01:35:10.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc3fffff640 10 client.104159.objecter _finish_command 2 = system:0 2026-02-21T01:35:10.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc3fffff640 20 client.104159.objecter put_session s=0x7fc3f4064480 osd=0 4 2026-02-21T01:35:10.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc3fffff640 15 client.104159.objecter _session_command_op_remove 0 2 2026-02-21T01:35:10.821 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:10.821 INFO:teuthology.orchestra.run.trial043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-21T01:35:10.821 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:10.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 10 librados: watch_flush enter 2026-02-21T01:35:10.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 10 librados: watch_flush exit 2026-02-21T01:35:10.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 10 client.104159.objecter close_session for osd.0 2026-02-21T01:35:10.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 >> v1:10.20.193.43:6800/1072173340 conn(0x7fc3f4064b30 legacy=0x7fc3f4084fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 20 client.104159.objecter put_session s=0x7fc3f4064480 osd=0 1 2026-02-21T01:35:10.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 20 client.104159.objecter shutdown clearing up homeless session... 2026-02-21T01:35:10.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 10 client.104159.objecter successfully canceled tick 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 >> v1:10.20.193.46:6812/860801619 conn(0x7fc3f403ec00 legacy=0x7fc3f405f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 10 monclient: shutdown 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 >> v1:10.20.193.43:6790/0 conn(0x7fc42408ddb0 legacy=0x7fc42418e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc423fff640 1 -- 10.20.193.43:0/2851606664 reap_dead start 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 shutdown_connections 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 >> 10.20.193.43:0/2851606664 conn(0x7fc42408f480 msgr2=0x7fc4241a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 shutdown_connections 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 -- 10.20.193.43:0/2851606664 wait complete. 2026-02-21T01:35:10.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.797+0000 7fc429bcf640 1 librados: shutdown 2026-02-21T01:35:10.824 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-21T01:35:10.892 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.891+0000 7f05f5c5b640 10 monclient: get_monmap_and_config 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.891+0000 7f05f5c5b640 10 monclient: build_initial_monmap 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.891+0000 7f05f5c5b640 10 monclient: monmap: 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:10.892593+0000 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:10.892593+0000 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:10.893 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:10.894 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.901 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.891+0000 7f05f5c5b640 1 Processor -- start 2026-02-21T01:35:10.901 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.891+0000 7f05f5c5b640 1 -- start start 2026-02-21T01:35:10.901 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.891+0000 7f05f5c5b640 10 monclient: init 2026-02-21T01:35:10.901 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:10.901 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:35:10.901 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f05f0058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f05f0057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f05f0181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f0056c50 con 0x7f05f0057630 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f008eda0 con 0x7f05f0058260 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f008f5c0 con 0x7f05f0181e80 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient(hunting): authenticate will time out at 1042.598186s 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05eeffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f05f0057630 0x7f05f008e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33210/0 (socket says 10.20.193.43:33210) 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05eeffd640 1 -- 10.20.193.43:0/1741641008 learned_addr learned my addr 10.20.193.43:0/1741641008 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534616186 0 0) 0x7f05f0056c50 con 0x7f05f0057630 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.902 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): my global_id is 25200 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d4003610 con 0x7f05f0057630 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922972255 0 0) 0x7f05f008f5c0 con 0x7f05f0181e80 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient(hunting): my global_id is 104162 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f0056c50 con 0x7f05f0181e80 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1617150955 0 0) 0x7f05d4003610 con 0x7f05f0057630 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 >> v1:10.20.193.43:6790/0 conn(0x7f05f0181e80 legacy=0x7f05f01a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 >> v1:10.20.193.46:6789/0 conn(0x7f05f0058260 legacy=0x7f05f008df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:35:10.903 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 monclient: found mon.noname-a 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f00563b0 con 0x7f05f0057630 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: _finish_auth 0 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f05e0002df0 con 0x7f05f0057630 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: dump: 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.904 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 5 monclient: authenticate success, global_id 25200 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05e0003040 con 0x7f05f0057630 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 1 -- 10.20.193.43:0/1741641008 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f05e0003480 con 0x7f05f0057630 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:10.905 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 4 set_mon_vals no callback set 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05ee7fc640 10 monclient: dump: 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.906 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 10 monclient: shutdown 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1741641008 >> v1:10.20.193.43:6789/0 conn(0x7f05f0057630 legacy=0x7f05f008e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1741641008 shutdown_connections 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1741641008 >> 10.20.193.43:0/1741641008 conn(0x7f05f0090360 msgr2=0x7f05f0090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1741641008 shutdown_connections 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.892+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1741641008 wait complete. 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient: build_initial_monmap 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient: monmap: 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:10.907 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 librados: starting msgr at 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 librados: starting objecter 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 Processor -- start 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 -- start start 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 librados: setting wanted keys 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 librados: calling monclient init 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient: init 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:10.908 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f05f0057630 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f05f0058260 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f05f0181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f0149600 con 0x7f05f0057630 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f0130850 con 0x7f05f0058260 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f012df50 con 0x7f05f0181e80 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05f5c5b640 10 monclient(hunting): authenticate will time out at 1042.599878s 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05ef7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f05f0057630 0x7f05f0148ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:33222/0 (socket says 10.20.193.43:33222) 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05ef7fe640 1 -- 10.20.193.43:0/1425591149 learned_addr learned my addr 10.20.193.43:0/1425591149 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05cbfff640 10 client.?.objecter ms_handle_connect 0x7f05f0181e80 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05cbfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05cbfff640 10 client.?.objecter ms_handle_connect 0x7f05f0057630 2026-02-21T01:35:10.909 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.893+0000 7f05cbfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1139402978 0 0) 0x7f05f012df50 con 0x7f05f0181e80 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): my global_id is 104165 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c0003610 con 0x7f05f0181e80 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129333406 0 0) 0x7f05f0149600 con 0x7f05f0057630 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): my global_id is 25203 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f012df50 con 0x7f05f0057630 2026-02-21T01:35:10.910 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3671515289 0 0) 0x7f05c0003610 con 0x7f05f0181e80 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05f0149600 con 0x7f05f0181e80 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f05e4003400 con 0x7f05f0181e80 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): dump: 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.911 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4056173027 0 0) 0x7f05f012df50 con 0x7f05f0057630 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c0003610 con 0x7f05f0057630 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f05dc0030c0 con 0x7f05f0057630 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient(hunting): dump: 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.912 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1951865645 0 0) 0x7f05f0149600 con 0x7f05f0181e80 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 >> v1:10.20.193.46:6789/0 conn(0x7f05f0058260 legacy=0x7f05f01702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 >> v1:10.20.193.43:6789/0 conn(0x7f05f0057630 legacy=0x7f05f0148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: _finish_hunting 0 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 monclient: found mon.c 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f012f9e0 con 0x7f05f0181e80 2026-02-21T01:35:10.913 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: _finish_auth 0 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: _check_auth_tickets 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 client.?.objecter ms_handle_connect 0x7f05f0058260 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 5 monclient: authenticate success, global_id 104165 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 monclient: _renew_subs 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05f012e4f0 con 0x7f05f0181e80 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 client.104165.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 monclient: _renew_subs 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f05f012f230 con 0x7f05f0181e80 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 1 librados: init done 2026-02-21T01:35:10.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05e4003a80 con 0x7f05f0181e80 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f05e4003dd0 con 0x7f05f0181e80 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 monclient: dump: 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:10.915 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05edffb640 4 set_mon_vals no callback set 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f00008d0 con 0x7f05f0181e80 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f05e4010750 con 0x7f05f0181e80 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f05e404d170 con 0x7f05f0181e80 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 10 client.104165.objecter ms_dispatch2 0x7f05f0000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 3 client.104165.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.894+0000 7f05cbfff640 3 client.104165.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.895+0000 7f05cbfff640 20 client.104165.objecter dump_active .. 0 homeless 2026-02-21T01:35:10.916 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.895+0000 7f05ef7fe640 10 monclient: get_auth_request con 0x7f05c003ea30 auth_method 0 2026-02-21T01:35:10.917 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.895+0000 7f05cbfff640 10 client.104165.objecter ms_handle_connect 0x7f05c003ea30 2026-02-21T01:35:10.917 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.897+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f05e4016790 con 0x7f05f0181e80 2026-02-21T01:35:10.917 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.897+0000 7f05cbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:10.917 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:10.897+0000 7f05cbfff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:11.006 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.004+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f05f0055f10 con 0x7f05c003ea30 2026-02-21T01:35:11.006 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.004+0000 7f05cbfff640 1 -- 10.20.193.43:0/1425591149 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f05f0055f10 con 0x7f05c003ea30 2026-02-21T01:35:11.006 INFO:teuthology.orchestra.run.trial043.stderr:instructed osd(s) 0 to deep-scrub 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 10 librados: watch_flush enter 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 10 librados: watch_flush exit 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 20 client.104165.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 10 client.104165.objecter successfully canceled tick 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 >> v1:10.20.193.46:6812/860801619 conn(0x7f05c003ea30 legacy=0x7f05c005eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 10 monclient: shutdown 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.008 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 >> v1:10.20.193.43:6790/0 conn(0x7f05f0181e80 legacy=0x7f05f01719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 shutdown_connections 2026-02-21T01:35:11.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 >> 10.20.193.43:0/1425591149 conn(0x7f05f0090360 msgr2=0x7f05f008aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 shutdown_connections 2026-02-21T01:35:11.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 1 -- 10.20.193.43:0/1425591149 wait complete. 2026-02-21T01:35:11.009 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.005+0000 7f05f5c5b640 1 librados: shutdown 2026-02-21T01:35:11.015 INFO:tasks.ceph:Scrubbing osd.1 2026-02-21T01:35:11.015 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-21T01:35:11.084 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.083+0000 7f6b72a67640 10 monclient: get_monmap_and_config 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.083+0000 7f6b72a67640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.083+0000 7f6b72a67640 10 monclient: monmap: 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:11.084521+0000 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:11.084521+0000 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.085 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:11.086 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:11.086 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.092 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.083+0000 7f6b72a67640 1 Processor -- start 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.083+0000 7f6b72a67640 1 -- start start 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.083+0000 7f6b72a67640 10 monclient: init 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient(hunting): picked mon.noname-c con 0x7f6b6c090280 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient(hunting): picked mon.noname-a con 0x7f6b6c0584d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient(hunting): picked mon.noname-b con 0x7f6b6c0588c0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c088330 con 0x7f6b6c0584d0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c090c40 con 0x7f6b6c090280 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c08d9e0 con 0x7f6b6c0588c0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient(hunting): authenticate will time out at 1042.790123s 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b70fdd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f6b6c0588c0 0x7f6b6c1a19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50286/0 (socket says 10.20.193.43:50286) 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b70fdd640 1 -- 10.20.193.43:0/3266013533 learned_addr learned my addr 10.20.193.43:0/3266013533 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6b7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 0x7f6b6c1802c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:50962/0 (socket says 10.20.193.43:50962) 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6b7fe640 1 -- 10.20.193.43:0/3266013533 >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 legacy=0x7f6b6c1802c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6b7fe640 1 -- 10.20.193.43:0/3266013533 >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 legacy=0x7f6b6c1802c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6b7fe640 1 --1- 10.20.193.43:0/3266013533 >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 0x7f6b6c1802c0 :-1 s=OPENED pgs=8500 cs=1 l=1).handle_message read tag failed 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6b7fe640 1 --1- 10.20.193.43:0/3266013533 >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 0x7f6b6c1802c0 :-1 s=OPENED pgs=8500 cs=1 l=1).fault on lossy channel, failing 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.43:6789/0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416522373 0 0) 0x7f6b6c08d9e0 con 0x7f6b6c0588c0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient(hunting): my global_id is 104168 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b50003610 con 0x7f6b6c0588c0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3045451015 0 0) 0x7f6b50003610 con 0x7f6b6c0588c0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 >> v1:10.20.193.46:6789/0 conn(0x7f6b6c090280 legacy=0x7f6b6c13f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 legacy=0x7f6b6c1802c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.093 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 monclient: found mon.noname-b 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c056cc0 con 0x7f6b6c0588c0 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6b60003170 con 0x7f6b6c0588c0 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 5 monclient: authenticate success, global_id 104168 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: dump: 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.094 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b60003400 con 0x7f6b6c0588c0 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 1 -- 10.20.193.43:0/3266013533 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6b60003840 con 0x7f6b6c0588c0 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 4 set_mon_vals no callback set 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b6affd640 10 monclient: dump: 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.095 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 10 monclient: shutdown 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- 10.20.193.43:0/3266013533 >> v1:10.20.193.43:6790/0 conn(0x7f6b6c0588c0 legacy=0x7f6b6c1a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- 10.20.193.43:0/3266013533 shutdown_connections 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- 10.20.193.43:0/3266013533 >> 10.20.193.43:0/3266013533 conn(0x7f6b6c091c20 msgr2=0x7f6b6c08de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- 10.20.193.43:0/3266013533 shutdown_connections 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.084+0000 7f6b72a67640 1 -- 10.20.193.43:0/3266013533 wait complete. 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient: monmap: 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.096 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 librados: starting msgr at 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 librados: starting objecter 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 Processor -- start 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 -- start start 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 librados: setting wanted keys 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 librados: calling monclient init 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient: init 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient(hunting): picked mon.noname-a con 0x7f6b6c0584d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.097 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient(hunting): picked mon.noname-b con 0x7f6b6c0588c0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient(hunting): picked mon.noname-c con 0x7f6b6c090280 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c128b20 con 0x7f6b6c0584d0 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c13e3f0 con 0x7f6b6c0588c0 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c12a5e0 con 0x7f6b6c090280 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b72a67640 10 monclient(hunting): authenticate will time out at 1042.791692s 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b6bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 0x7f6b6c122fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:50976/0 (socket says 10.20.193.43:50976) 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b6bfff640 1 -- 10.20.193.43:0/1489950227 learned_addr learned my addr 10.20.193.43:0/1489950227 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 client.?.objecter ms_handle_connect 0x7f6b6c090280 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 client.?.objecter ms_handle_connect 0x7f6b6c0584d0 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963788463 0 0) 0x7f6b6c12a5e0 con 0x7f6b6c090280 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): my global_id is 104171 2026-02-21T01:35:11.098 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b3c003610 con 0x7f6b6c090280 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852387014 0 0) 0x7f6b6c128b20 con 0x7f6b6c0584d0 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 10 monclient(hunting): my global_id is 25206 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b6c12a5e0 con 0x7f6b6c0584d0 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2729635295 0 0) 0x7f6b3c003610 con 0x7f6b6c090280 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.085+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b6c128b20 con 0x7f6b6c090280 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6b600035b0 con 0x7f6b6c090280 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.099 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 78243694 0 0) 0x7f6b6c12a5e0 con 0x7f6b6c0584d0 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b3c003610 con 0x7f6b6c0584d0 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 client.?.objecter ms_handle_connect 0x7f6b6c0588c0 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6b58003000 con 0x7f6b6c0584d0 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.100 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1491938826 0 0) 0x7f6b6c128b20 con 0x7f6b6c090280 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 >> v1:10.20.193.46:6789/0 conn(0x7f6b6c0588c0 legacy=0x7f6b6c1a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 >> v1:10.20.193.43:6789/0 conn(0x7f6b6c0584d0 legacy=0x7f6b6c122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 monclient: found mon.c 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c12a8c0 con 0x7f6b6c090280 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 5 monclient: authenticate success, global_id 104171 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 monclient: _renew_subs 2026-02-21T01:35:11.101 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c12aba0 con 0x7f6b6c090280 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 client.104171.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 monclient: _renew_subs 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b6c112b70 con 0x7f6b6c090280 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 1 librados: init done 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b60004e30 con 0x7f6b6c090280 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6b60005180 con 0x7f6b6c090280 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b6a7fc640 4 set_mon_vals no callback set 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 10 monclient: dump: 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.102 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 client.104171.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 15 client.104171.objecter _session_command_op_assign -1 1 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 20 client.104171.objecter _get_session osd=-1 returning homeless 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 client.104171.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6b6c112eb0 con 0x7f6b6c090280 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.086+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f6b60011b00 con 0x7f6b6c090280 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f6b6004e2e0 con 0x7f6b6c090280 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 client.104171.objecter ms_dispatch2 0x7f6b6c000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 3 client.104171.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 3 client.104171.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 client.104171.objecter checking command 1 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 20 client.104171.objecter _get_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 20 client.104171.objecter put_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 15 client.104171.objecter _session_command_op_remove -1 1 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 20 client.104171.objecter _get_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 20 client.104171.objecter get_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 15 client.104171.objecter _session_command_op_assign 1 1 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 20 client.104171.objecter put_session s=0x7f6b3c064360 osd=1 4 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 client.104171.objecter _send_command 1 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6808/3522371706 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b60003400 con 0x7f6b3c064a10 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 20 client.104171.objecter dump_active .. 0 homeless 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_get_version_reply(handle=1 version=321) ==== 24+0+0 (unknown 1047129514 0 0) 0x7f6b6004e6f0 con 0x7f6b6c090280 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 monclient: handle_get_version_reply finishing 1 version 321 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b6bfff640 10 monclient: get_auth_request con 0x7f6b3c03e9f0 auth_method 0 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b6b7fe640 10 monclient: get_auth_request con 0x7f6b3c064a10 auth_method 0 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 client.104171.objecter ms_handle_connect 0x7f6b3c064a10 2026-02-21T01:35:11.103 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 client.104171.objecter ms_handle_connect 0x7f6b3c03e9f0 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== osd.1 v1:10.20.193.43:6808/3522371706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6b60003400 con 0x7f6b3c064a10 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 client.104171.objecter ms_dispatch2 0x7f6b6c000b90 command_reply(tid 1: 0 ) 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 10 client.104171.objecter _finish_command 1 = system:0 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 20 client.104171.objecter put_session s=0x7f6b3c064360 osd=1 4 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.087+0000 7f6b68ff9640 15 client.104171.objecter _session_command_op_remove 1 1 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 10 client.104171.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 15 client.104171.objecter _session_command_op_assign -1 2 2026-02-21T01:35:11.104 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 client.104171.objecter _get_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 client.104171.objecter put_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 client.104171.objecter _get_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 15 client.104171.objecter _session_command_op_remove -1 2 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 client.104171.objecter get_session s=0x7f6b3c064360 osd=1 3 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 15 client.104171.objecter _session_command_op_assign 1 2 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 client.104171.objecter put_session s=0x7f6b3c064360 osd=1 4 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 10 client.104171.objecter _send_command 2 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 --> v1:10.20.193.43:6808/3522371706 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6b6c1280c0 con 0x7f6b3c064a10 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b68ff9640 1 -- 10.20.193.43:0/1489950227 <== osd.1 v1:10.20.193.43:6808/3522371706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6b6c1280c0 con 0x7f6b3c064a10 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b68ff9640 10 client.104171.objecter ms_dispatch2 0x7f6b6c000b90 command_reply(tid 2: 0 ) 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b68ff9640 10 client.104171.objecter _finish_command 2 = system:0 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b68ff9640 20 client.104171.objecter put_session s=0x7f6b3c064360 osd=1 4 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b68ff9640 15 client.104171.objecter _session_command_op_remove 1 2 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-21T01:35:11.105 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:11.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 10 librados: watch_flush enter 2026-02-21T01:35:11.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 10 librados: watch_flush exit 2026-02-21T01:35:11.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 10 client.104171.objecter close_session for osd.1 2026-02-21T01:35:11.106 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 >> v1:10.20.193.43:6808/3522371706 conn(0x7f6b3c064a10 legacy=0x7f6b3c084ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 client.104171.objecter put_session s=0x7f6b3c064360 osd=1 1 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 client.104171.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 10 client.104171.objecter successfully canceled tick 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 >> v1:10.20.193.46:6812/860801619 conn(0x7f6b3c03e9f0 legacy=0x7f6b3c05eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 10 monclient: shutdown 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 >> v1:10.20.193.43:6790/0 conn(0x7f6b6c090280 legacy=0x7f6b6c1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.094+0000 7f6b70fdd640 1 -- 10.20.193.43:0/1489950227 reap_dead start 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.095+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 shutdown_connections 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.095+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 >> 10.20.193.43:0/1489950227 conn(0x7f6b6c091c20 msgr2=0x7f6b6c057380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.095+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 shutdown_connections 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.095+0000 7f6b72a67640 1 -- 10.20.193.43:0/1489950227 wait complete. 2026-02-21T01:35:11.107 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.095+0000 7f6b72a67640 1 librados: shutdown 2026-02-21T01:35:11.107 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.173+0000 7feb202e1640 10 monclient: get_monmap_and_config 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.173+0000 7feb202e1640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.173+0000 7feb202e1640 10 monclient: monmap: 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:11.175189+0000 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:11.175189+0000 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:11.175 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.176 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 1 Processor -- start 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 1 -- start start 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient: init 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient(hunting): picked mon.noname-c con 0x7feb1808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient(hunting): picked mon.noname-b con 0x7feb1808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient(hunting): picked mon.noname-a con 0x7feb1808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1808a690 con 0x7feb1808d8d0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1808b910 con 0x7feb1808ddb0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb18088ae0 con 0x7feb1808d4d0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 10 monclient(hunting): authenticate will time out at 1042.880567s 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d855640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7feb1808d4d0 0x7feb1817e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50312/0 (socket says 10.20.193.43:50312) 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d855640 1 -- 10.20.193.43:0/3664021713 learned_addr learned my addr 10.20.193.43:0/3664021713 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1e857640 1 --1- 10.20.193.43:0/3664021713 >> v1:10.20.193.43:6789/0 conn(0x7feb1808d8d0 0x7feb1819f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:50980/0 (socket says 10.20.193.43:50980) 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045060776 0 0) 0x7feb18088ae0 con 0x7feb1808d4d0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): my global_id is 104174 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb00003610 con 0x7feb1808d4d0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123682889 0 0) 0x7feb1808a690 con 0x7feb1808d8d0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient(hunting): my global_id is 25209 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb18088ae0 con 0x7feb1808d8d0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 801108033 0 0) 0x7feb00003610 con 0x7feb1808d4d0 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 >> v1:10.20.193.46:6789/0 conn(0x7feb1808ddb0 legacy=0x7feb1808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 >> v1:10.20.193.43:6789/0 conn(0x7feb1808d8d0 legacy=0x7feb1819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.177 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 monclient: found mon.noname-b 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb181a3ef0 con 0x7feb1808d4d0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7feb0c002df0 con 0x7feb1808d4d0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb1d054640 10 monclient: dump: 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 5 monclient: authenticate success, global_id 104174 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.174+0000 7feb202e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb0c0030f0 con 0x7feb1808d4d0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb1d054640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb1d054640 1 -- 10.20.193.43:0/3664021713 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7feb0c003530 con 0x7feb1808d4d0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 4 set_mon_vals no callback set 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb1d054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb1d054640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb1d054640 10 monclient: dump: 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.178 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 10 monclient: shutdown 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 -- 10.20.193.43:0/3664021713 >> v1:10.20.193.43:6790/0 conn(0x7feb1808d4d0 legacy=0x7feb1817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 -- 10.20.193.43:0/3664021713 shutdown_connections 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 -- 10.20.193.43:0/3664021713 >> 10.20.193.43:0/3664021713 conn(0x7feb1808f480 msgr2=0x7feb1808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 -- 10.20.193.43:0/3664021713 shutdown_connections 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 -- 10.20.193.43:0/3664021713 wait complete. 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 10 monclient: monmap: 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 librados: starting msgr at 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 librados: starting objecter 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 Processor -- start 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 -- start start 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 librados: setting wanted keys 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 1 librados: calling monclient init 2026-02-21T01:35:11.179 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.175+0000 7feb202e1640 10 monclient: init 2026-02-21T01:35:11.180 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient(hunting): picked mon.noname-c con 0x7feb1808d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient(hunting): picked mon.noname-a con 0x7feb1808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient(hunting): picked mon.noname-b con 0x7feb1808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1810a7c0 con 0x7feb1808d8d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1810aaa0 con 0x7feb1808ddb0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb180572e0 con 0x7feb1808d4d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient(hunting): authenticate will time out at 1042.882094s 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb1d855640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7feb1808d8d0 0x7feb18086c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:50986/0 (socket says 10.20.193.43:50986) 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb1d855640 1 -- 10.20.193.43:0/3536653738 learned_addr learned my addr 10.20.193.43:0/3536653738 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 client.?.objecter ms_handle_connect 0x7feb1808d8d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 client.?.objecter ms_handle_connect 0x7feb1808d4d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752772479 0 0) 0x7feb1810a7c0 con 0x7feb1808d8d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): my global_id is 25212 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae8003610 con 0x7feb1808d8d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675252438 0 0) 0x7feb180572e0 con 0x7feb1808d4d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): my global_id is 104177 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb1810a7c0 con 0x7feb1808d4d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1678833000 0 0) 0x7feae8003610 con 0x7feb1808d8d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb180572e0 con 0x7feb1808d8d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7feb0c002db0 con 0x7feb1808d8d0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): dump: 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.181 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3268439304 0 0) 0x7feb1810a7c0 con 0x7feb1808d4d0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feae8003610 con 0x7feb1808d4d0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7feb08003090 con 0x7feb1808d4d0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient(hunting): dump: 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3333747251 0 0) 0x7feb180572e0 con 0x7feb1808d8d0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 >> v1:10.20.193.43:6790/0 conn(0x7feb1808d4d0 legacy=0x7feb18086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 >> v1:10.20.193.46:6789/0 conn(0x7feb1808ddb0 legacy=0x7feb1818ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 monclient: found mon.a 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1805e1b0 con 0x7feb1808d8d0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 client.?.objecter ms_handle_connect 0x7feb1808ddb0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 5 monclient: authenticate success, global_id 25212 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _renew_subs 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb1805c460 con 0x7feb1808d8d0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb0c004d50 con 0x7feb1808d8d0 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.182 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 client.25212.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7feb0c0050a0 con 0x7feb1808d8d0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feafeffd640 10 monclient: dump: 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb1c853640 4 set_mon_vals no callback set 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _renew_subs 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb18087bf0 con 0x7feb1808d8d0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 1 librados: init done 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.176+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb1808edb0 con 0x7feb1808d8d0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7feb0c011a20 con 0x7feb1808d8d0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7feb0c04dfc0 con 0x7feb1808d8d0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feafeffd640 10 client.25212.objecter ms_dispatch2 0x7feb18000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feafeffd640 3 client.25212.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feafeffd640 3 client.25212.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feafeffd640 20 client.25212.objecter dump_active .. 0 homeless 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feb1e056640 10 monclient: get_auth_request con 0x7feae803e950 auth_method 0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.177+0000 7feafeffd640 10 client.25212.objecter ms_handle_connect 0x7feae803e950 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.179+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7feb0c017840 con 0x7feb1808d8d0 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.179+0000 7feafeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.183 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.179+0000 7feafeffd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:11.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.287+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7feb18054ff0 con 0x7feae803e950 2026-02-21T01:35:11.289 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.287+0000 7feafeffd640 1 -- 10.20.193.43:0/3536653738 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7feb18054ff0 con 0x7feae803e950 2026-02-21T01:35:11.289 INFO:teuthology.orchestra.run.trial043.stderr:instructed osd(s) 1 to deep-scrub 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 10 librados: watch_flush enter 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 10 librados: watch_flush exit 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 20 client.25212.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 10 client.25212.objecter successfully canceled tick 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 >> v1:10.20.193.46:6812/860801619 conn(0x7feae803e950 legacy=0x7feae805ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 10 monclient: shutdown 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 >> v1:10.20.193.43:6789/0 conn(0x7feb1808d8d0 legacy=0x7feb18086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 shutdown_connections 2026-02-21T01:35:11.291 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 >> 10.20.193.43:0/3536653738 conn(0x7feb1808f480 msgr2=0x7feb1811ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 shutdown_connections 2026-02-21T01:35:11.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 1 -- 10.20.193.43:0/3536653738 wait complete. 2026-02-21T01:35:11.292 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.288+0000 7feb202e1640 1 librados: shutdown 2026-02-21T01:35:11.297 INFO:tasks.ceph:Scrubbing osd.2 2026-02-21T01:35:11.298 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-21T01:35:11.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.364+0000 7f3def29f640 10 monclient: get_monmap_and_config 2026-02-21T01:35:11.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.364+0000 7f3def29f640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.364+0000 7f3def29f640 10 monclient: monmap: 2026-02-21T01:35:11.375 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.375 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.375 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:11.365877+0000 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:11.365877+0000 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.364+0000 7f3def29f640 1 Processor -- start 2026-02-21T01:35:11.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.364+0000 7f3def29f640 1 -- start start 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.364+0000 7f3def29f640 10 monclient: init 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient(hunting): picked mon.noname-b con 0x7f3de808ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient(hunting): picked mon.noname-c con 0x7f3de808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient(hunting): picked mon.noname-a con 0x7f3de808d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de808a690 con 0x7f3de808d8d0 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de808b910 con 0x7f3de808d4d0 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de8088ae0 con 0x7f3de808ddb0 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient(hunting): authenticate will time out at 1043.071262s 2026-02-21T01:35:11.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3ded014640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f3de808ddb0 0x7f3de808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50328/0 (socket says 10.20.193.43:50328) 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3ded014640 1 -- 10.20.193.43:0/3300609225 learned_addr learned my addr 10.20.193.43:0/3300609225 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729343341 0 0) 0x7f3de8088ae0 con 0x7f3de808ddb0 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): my global_id is 104180 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dd0003610 con 0x7f3de808ddb0 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82530316 0 0) 0x7f3de808a690 con 0x7f3de808d8d0 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient(hunting): my global_id is 25215 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de8088ae0 con 0x7f3de808d8d0 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1854988421 0 0) 0x7f3dd0003610 con 0x7f3de808ddb0 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 >> v1:10.20.193.46:6789/0 conn(0x7f3de808d4d0 legacy=0x7f3de817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 >> v1:10.20.193.43:6789/0 conn(0x7f3de808d8d0 legacy=0x7f3de819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 monclient: found mon.noname-b 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de81a3ef0 con 0x7f3de808ddb0 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 5 monclient: authenticate success, global_id 104180 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3dd8002df0 con 0x7f3de808ddb0 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: dump: 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.380 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3dd80030b0 con 0x7f3de808ddb0 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 1 -- 10.20.193.43:0/3300609225 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3dd80034f0 con 0x7f3de808ddb0 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 4 set_mon_vals no callback set 2026-02-21T01:35:11.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3dd7fff640 10 monclient: dump: 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.382 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 10 monclient: shutdown 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 1 -- 10.20.193.43:0/3300609225 >> v1:10.20.193.43:6790/0 conn(0x7f3de808ddb0 legacy=0x7f3de808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 1 -- 10.20.193.43:0/3300609225 shutdown_connections 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.365+0000 7f3def29f640 1 -- 10.20.193.43:0/3300609225 >> 10.20.193.43:0/3300609225 conn(0x7f3de808f480 msgr2=0x7f3de808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 -- 10.20.193.43:0/3300609225 shutdown_connections 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 -- 10.20.193.43:0/3300609225 wait complete. 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient: monmap: 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:11.383 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 librados: starting msgr at 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 librados: starting objecter 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 Processor -- start 2026-02-21T01:35:11.384 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 -- start start 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 librados: setting wanted keys 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 librados: calling monclient init 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient: init 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient(hunting): picked mon.noname-b con 0x7f3de808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient(hunting): picked mon.noname-c con 0x7f3de808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient(hunting): picked mon.noname-a con 0x7f3de808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de8127a00 con 0x7f3de808ddb0 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de8109610 con 0x7f3de808d4d0 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de812abc0 con 0x7f3de808d8d0 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.385 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3def29f640 10 monclient(hunting): authenticate will time out at 1043.072787s 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dec813640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f3de808d8d0 0x7f3de81272f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50332/0 (socket says 10.20.193.43:50332) 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dec813640 1 -- 10.20.193.43:0/1351213799 learned_addr learned my addr 10.20.193.43:0/1351213799 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3ded815640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f3de808ddb0 0x7f3de819b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51018/0 (socket says 10.20.193.43:51018) 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 client.?.objecter ms_handle_connect 0x7f3de808d8d0 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 client.?.objecter ms_handle_connect 0x7f3de808ddb0 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4190602843 0 0) 0x7f3de812abc0 con 0x7f3de808d8d0 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.386 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): my global_id is 104183 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3db8003610 con 0x7f3de808d8d0 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 client.?.objecter ms_handle_connect 0x7f3de808d4d0 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419286624 0 0) 0x7f3de8127a00 con 0x7f3de808ddb0 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 10 monclient(hunting): my global_id is 25218 2026-02-21T01:35:11.387 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.366+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de812abc0 con 0x7f3de808ddb0 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2236233318 0 0) 0x7f3db8003610 con 0x7f3de808d8d0 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3de8127a00 con 0x7f3de808d8d0 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3ddc003190 con 0x7f3de808d8d0 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): dump: 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.388 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2269607229 0 0) 0x7f3de812abc0 con 0x7f3de808ddb0 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3db8003610 con 0x7f3de808ddb0 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2792064484 0 0) 0x7f3de8109610 con 0x7f3de808d4d0 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): my global_id is 84403 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de812abc0 con 0x7f3de808d4d0 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3de4003540 con 0x7f3de808ddb0 2026-02-21T01:35:11.389 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient(hunting): dump: 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.390 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2274673404 0 0) 0x7f3de8127a00 con 0x7f3de808d8d0 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 >> v1:10.20.193.46:6789/0 conn(0x7f3de808d4d0 legacy=0x7f3de8126be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 >> v1:10.20.193.43:6789/0 conn(0x7f3de808ddb0 legacy=0x7f3de819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 monclient: found mon.c 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de810b970 con 0x7f3de808d8d0 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 5 monclient: authenticate success, global_id 104183 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 monclient: _renew_subs 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.391 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3de810b0d0 con 0x7f3de808d8d0 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 client.104183.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 monclient: _renew_subs 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3de810a350 con 0x7f3de808d8d0 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ddc0039b0 con 0x7f3de808d8d0 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 1 librados: init done 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f3ddc003d80 con 0x7f3de808d8d0 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: dump: 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.392 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd77fe640 4 set_mon_vals no callback set 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 client.104183.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 15 client.104183.objecter _session_command_op_assign -1 1 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 20 client.104183.objecter _get_session osd=-1 returning homeless 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 client.104183.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3de810ad40 con 0x7f3de808d8d0 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f3ddc003fa0 con 0x7f3de808d8d0 2026-02-21T01:35:11.393 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f3ddc04e2a0 con 0x7f3de808d8d0 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 client.104183.objecter ms_dispatch2 0x7f3de8000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 3 client.104183.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 3 client.104183.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 client.104183.objecter checking command 1 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 client.104183.objecter _get_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 client.104183.objecter put_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 15 client.104183.objecter _session_command_op_remove -1 1 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 client.104183.objecter _get_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 client.104183.objecter get_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 15 client.104183.objecter _session_command_op_assign 2 1 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 client.104183.objecter put_session s=0x7f3db80644c0 osd=2 4 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 client.104183.objecter _send_command 1 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6804/3123352217 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3db8086870 con 0x7f3db8064b70 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 20 client.104183.objecter dump_active .. 0 homeless 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_get_version_reply(handle=1 version=321) ==== 24+0+0 (unknown 1047129514 0 0) 0x7f3ddc04e6b0 con 0x7f3de808d8d0 2026-02-21T01:35:11.394 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.367+0000 7f3dd5ffb640 10 monclient: handle_get_version_reply finishing 1 version 321 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3ded815640 10 monclient: get_auth_request con 0x7f3db8064b70 auth_method 0 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3ded014640 10 monclient: get_auth_request con 0x7f3db803eb50 auth_method 0 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3dd5ffb640 10 client.104183.objecter ms_handle_connect 0x7f3db8064b70 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3dd5ffb640 10 client.104183.objecter ms_handle_connect 0x7f3db803eb50 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== osd.2 v1:10.20.193.43:6804/3123352217 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f3db8086870 con 0x7f3db8064b70 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3dd5ffb640 10 client.104183.objecter ms_dispatch2 0x7f3de8000b90 command_reply(tid 1: 0 ) 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3dd5ffb640 10 client.104183.objecter _finish_command 1 = system:0 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3dd5ffb640 20 client.104183.objecter put_session s=0x7f3db80644c0 osd=2 4 2026-02-21T01:35:11.395 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.368+0000 7f3dd5ffb640 15 client.104183.objecter _session_command_op_remove 2 1 2026-02-21T01:35:11.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 10 client.104183.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-21T01:35:11.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 15 client.104183.objecter _session_command_op_assign -1 2 2026-02-21T01:35:11.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 20 client.104183.objecter _get_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 20 client.104183.objecter put_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.396 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 20 client.104183.objecter _get_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 15 client.104183.objecter _session_command_op_remove -1 2 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 20 client.104183.objecter get_session s=0x7f3db80644c0 osd=2 3 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 15 client.104183.objecter _session_command_op_assign 2 2 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 20 client.104183.objecter put_session s=0x7f3db80644c0 osd=2 4 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 10 client.104183.objecter _send_command 2 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 --> v1:10.20.193.43:6804/3123352217 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3de805cad0 con 0x7f3db8064b70 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3dd5ffb640 1 -- 10.20.193.43:0/1351213799 <== osd.2 v1:10.20.193.43:6804/3123352217 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f3de805cad0 con 0x7f3db8064b70 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3dd5ffb640 10 client.104183.objecter ms_dispatch2 0x7f3de8000b90 command_reply(tid 2: 0 ) 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3dd5ffb640 10 client.104183.objecter _finish_command 2 = system:0 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3dd5ffb640 20 client.104183.objecter put_session s=0x7f3db80644c0 osd=2 4 2026-02-21T01:35:11.397 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3dd5ffb640 15 client.104183.objecter _session_command_op_remove 2 2 2026-02-21T01:35:11.398 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:11.398 INFO:teuthology.orchestra.run.trial043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-21T01:35:11.398 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 10 librados: watch_flush enter 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 10 librados: watch_flush exit 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 10 client.104183.objecter close_session for osd.2 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 >> v1:10.20.193.43:6804/3123352217 conn(0x7f3db8064b70 legacy=0x7f3db8085000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 20 client.104183.objecter put_session s=0x7f3db80644c0 osd=2 1 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 20 client.104183.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.375+0000 7f3def29f640 10 client.104183.objecter successfully canceled tick 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 >> v1:10.20.193.46:6812/860801619 conn(0x7f3db803eb50 legacy=0x7f3db805f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 10 monclient: shutdown 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 >> v1:10.20.193.43:6790/0 conn(0x7f3de808d8d0 legacy=0x7f3de81272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3ded815640 1 -- 10.20.193.43:0/1351213799 reap_dead start 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 shutdown_connections 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 >> 10.20.193.43:0/1351213799 conn(0x7f3de808f480 msgr2=0x7f3de81a3320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 shutdown_connections 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 1 -- 10.20.193.43:0/1351213799 wait complete. 2026-02-21T01:35:11.399 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.376+0000 7f3def29f640 1 librados: shutdown 2026-02-21T01:35:11.400 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-21T01:35:11.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.466+0000 7f889acf3640 10 monclient: get_monmap_and_config 2026-02-21T01:35:11.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.466+0000 7f889acf3640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.466+0000 7f889acf3640 10 monclient: monmap: 2026-02-21T01:35:11.467 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.467 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.467 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:11.467808+0000 2026-02-21T01:35:11.468 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:11.467808+0000 2026-02-21T01:35:11.468 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.468 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.468 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.468 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:11.468 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:11.468 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.466+0000 7f889acf3640 1 Processor -- start 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.466+0000 7f889acf3640 1 -- start start 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.466+0000 7f889acf3640 10 monclient: init 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient(hunting): picked mon.noname-b con 0x7f889405cef0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient(hunting): picked mon.noname-c con 0x7f889408a730 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient(hunting): picked mon.noname-a con 0x7f889413fa20 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889405d9d0 con 0x7f889413fa20 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889408b590 con 0x7f889408a730 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889405b9c0 con 0x7f889405cef0 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient(hunting): authenticate will time out at 1043.173216s 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f8899269640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f889413fa20 0x7f88941a1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51024/0 (socket says 10.20.193.43:51024) 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f8898a68640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f889405cef0 0x7f889405d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50340/0 (socket says 10.20.193.43:50340) 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f8899269640 1 -- 10.20.193.43:0/247833059 learned_addr learned my addr 10.20.193.43:0/247833059 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459945385 0 0) 0x7f889405b9c0 con 0x7f889405cef0 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): my global_id is 104186 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8880003610 con 0x7f889405cef0 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869930206 0 0) 0x7f889405d9d0 con 0x7f889413fa20 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient(hunting): my global_id is 25221 2026-02-21T01:35:11.469 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f889405b9c0 con 0x7f889413fa20 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3543529223 0 0) 0x7f889405b9c0 con 0x7f889413fa20 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 >> v1:10.20.193.43:6790/0 conn(0x7f889405cef0 legacy=0x7f889405d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 >> v1:10.20.193.46:6789/0 conn(0x7f889408a730 legacy=0x7f8894180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 monclient: found mon.noname-a 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889413f210 con 0x7f889413fa20 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f88900030f0 con 0x7f889413fa20 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: dump: 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 5 monclient: authenticate success, global_id 25221 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8890003330 con 0x7f889413fa20 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 1 -- 10.20.193.43:0/247833059 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8890003770 con 0x7f889413fa20 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 4 set_mon_vals no callback set 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f888b7fe640 10 monclient: dump: 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.470 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 10 monclient: shutdown 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 1 -- 10.20.193.43:0/247833059 >> v1:10.20.193.43:6789/0 conn(0x7f889413fa20 legacy=0x7f88941a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 1 -- 10.20.193.43:0/247833059 shutdown_connections 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.467+0000 7f889acf3640 1 -- 10.20.193.43:0/247833059 >> 10.20.193.43:0/247833059 conn(0x7f889408f480 msgr2=0x7f889408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 -- 10.20.193.43:0/247833059 shutdown_connections 2026-02-21T01:35:11.471 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 -- 10.20.193.43:0/247833059 wait complete. 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient: monmap: 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.472 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 librados: starting msgr at 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 librados: starting objecter 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 Processor -- start 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 -- start start 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 librados: setting wanted keys 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 librados: calling monclient init 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient: init 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient(hunting): picked mon.noname-b con 0x7f889405cef0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient(hunting): picked mon.noname-c con 0x7f889408a730 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient(hunting): picked mon.noname-a con 0x7f889413fa20 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8894126780 con 0x7f889413fa20 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8894128240 con 0x7f889405cef0 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88941272e0 con 0x7f889408a730 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.468+0000 7f889acf3640 10 monclient(hunting): authenticate will time out at 1043.174962s 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f888bfff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f889408a730 0x7f8894121180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50356/0 (socket says 10.20.193.43:50356) 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f888bfff640 1 -- 10.20.193.43:0/3543498150 learned_addr learned my addr 10.20.193.43:0/3543498150 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 client.?.objecter ms_handle_connect 0x7f889408a730 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 client.?.objecter ms_handle_connect 0x7f889413fa20 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50414657 0 0) 0x7f88941272e0 con 0x7f889408a730 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): my global_id is 104189 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8864003610 con 0x7f889408a730 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 client.?.objecter ms_handle_connect 0x7f889405cef0 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268854037 0 0) 0x7f8894126780 con 0x7f889413fa20 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): my global_id is 25224 2026-02-21T01:35:11.473 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88941272e0 con 0x7f889413fa20 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 40450137 0 0) 0x7f8864003610 con 0x7f889408a730 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8894126780 con 0x7f889408a730 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f887c003160 con 0x7f889408a730 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): dump: 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884793968 0 0) 0x7f8894128240 con 0x7f889405cef0 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): my global_id is 84406 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8864003610 con 0x7f889405cef0 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3484862291 0 0) 0x7f88941272e0 con 0x7f889413fa20 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8894128240 con 0x7f889413fa20 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f8890003000 con 0x7f889413fa20 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient(hunting): dump: 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3150252477 0 0) 0x7f8894126780 con 0x7f889408a730 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 >> v1:10.20.193.46:6789/0 conn(0x7f889405cef0 legacy=0x7f8894120a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 >> v1:10.20.193.43:6789/0 conn(0x7f889413fa20 legacy=0x7f88941a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.474 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 monclient: found mon.c 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894125d60 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 5 monclient: authenticate success, global_id 104189 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 monclient: _renew_subs 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8894125ff0 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 client.104189.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 monclient: _renew_subs 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f887c003510 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f88941a2930 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 1 librados: init done 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f887c003b50 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 10 monclient: dump: 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f888affd640 4 set_mon_vals no callback set 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f887c003d70 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.469+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889405e190 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.470+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f887c04e150 con 0x7f889408a730 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.470+0000 7f88897fa640 10 client.104189.objecter ms_dispatch2 0x7f8894000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.470+0000 7f88897fa640 3 client.104189.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:11.475 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.470+0000 7f88897fa640 3 client.104189.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:11.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.470+0000 7f88897fa640 20 client.104189.objecter dump_active .. 0 homeless 2026-02-21T01:35:11.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.470+0000 7f8898a68640 10 monclient: get_auth_request con 0x7f886403eba0 auth_method 0 2026-02-21T01:35:11.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.470+0000 7f88897fa640 10 client.104189.objecter ms_handle_connect 0x7f886403eba0 2026-02-21T01:35:11.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.472+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f887c017830 con 0x7f889408a730 2026-02-21T01:35:11.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.472+0000 7f88897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.476 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.472+0000 7f88897fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:11.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.583+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f889413c210 con 0x7f886403eba0 2026-02-21T01:35:11.585 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.583+0000 7f88897fa640 1 -- 10.20.193.43:0/3543498150 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f889413c210 con 0x7f886403eba0 2026-02-21T01:35:11.585 INFO:teuthology.orchestra.run.trial043.stderr:instructed osd(s) 2 to deep-scrub 2026-02-21T01:35:11.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 10 librados: watch_flush enter 2026-02-21T01:35:11.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 10 librados: watch_flush exit 2026-02-21T01:35:11.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 20 client.104189.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 10 client.104189.objecter successfully canceled tick 2026-02-21T01:35:11.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 >> v1:10.20.193.46:6812/860801619 conn(0x7f886403eba0 legacy=0x7f886405f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 10 monclient: shutdown 2026-02-21T01:35:11.587 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.588 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 >> v1:10.20.193.43:6790/0 conn(0x7f889408a730 legacy=0x7f8894121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.588 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 shutdown_connections 2026-02-21T01:35:11.588 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 >> 10.20.193.43:0/3543498150 conn(0x7f889408f480 msgr2=0x7f889408bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.588 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 shutdown_connections 2026-02-21T01:35:11.588 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 1 -- 10.20.193.43:0/3543498150 wait complete. 2026-02-21T01:35:11.588 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.585+0000 7f889acf3640 1 librados: shutdown 2026-02-21T01:35:11.595 INFO:tasks.ceph:Scrubbing osd.3 2026-02-21T01:35:11.596 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-21T01:35:11.674 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.663+0000 7fc1642e1640 10 monclient: get_monmap_and_config 2026-02-21T01:35:11.674 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.663+0000 7fc1642e1640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.674 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.663+0000 7fc1642e1640 10 monclient: monmap: 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:11.664985+0000 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:11.664985+0000 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:11.675 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 1 Processor -- start 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 1 -- start start 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient: init 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient(hunting): picked mon.noname-a con 0x7fc15c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient(hunting): picked mon.noname-c con 0x7fc15c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient(hunting): picked mon.noname-b con 0x7fc15c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c08a690 con 0x7fc15c08ddb0 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c08b910 con 0x7fc15c08d4d0 2026-02-21T01:35:11.676 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c088ae0 con 0x7fc15c08d8d0 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient(hunting): authenticate will time out at 1043.370386s 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc162056640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc15c08ddb0 0x7fc15c08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51034/0 (socket says 10.20.193.43:51034) 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc162056640 1 -- 10.20.193.43:0/367007388 learned_addr learned my addr 10.20.193.43:0/367007388 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2797856875 0 0) 0x7fc15c08a690 con 0x7fc15c08ddb0 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): my global_id is 25227 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc144003610 con 0x7fc15c08ddb0 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036590149 0 0) 0x7fc15c088ae0 con 0x7fc15c08d8d0 2026-02-21T01:35:11.677 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient(hunting): my global_id is 104192 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc15c08a690 con 0x7fc15c08d8d0 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1193297531 0 0) 0x7fc144003610 con 0x7fc15c08ddb0 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 >> v1:10.20.193.43:6790/0 conn(0x7fc15c08d8d0 legacy=0x7fc15c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 >> v1:10.20.193.46:6789/0 conn(0x7fc15c08d4d0 legacy=0x7fc15c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 monclient: found mon.noname-a 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.678 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c1a3ef0 con 0x7fc15c08ddb0 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc14c002df0 con 0x7fc15c08ddb0 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 5 monclient: authenticate success, global_id 25227 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: dump: 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.679 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc14c0030b0 con 0x7fc15c08ddb0 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 1 -- 10.20.193.43:0/367007388 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc14c003480 con 0x7fc15c08ddb0 2026-02-21T01:35:11.680 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc161054640 10 monclient: dump: 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.681 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.664+0000 7fc1642e1640 4 set_mon_vals no callback set 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient: shutdown 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 -- 10.20.193.43:0/367007388 >> v1:10.20.193.43:6789/0 conn(0x7fc15c08ddb0 legacy=0x7fc15c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 -- 10.20.193.43:0/367007388 shutdown_connections 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 -- 10.20.193.43:0/367007388 >> 10.20.193.43:0/367007388 conn(0x7fc15c08f480 msgr2=0x7fc15c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 -- 10.20.193.43:0/367007388 shutdown_connections 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 -- 10.20.193.43:0/367007388 wait complete. 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.682 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient: monmap: 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 librados: starting msgr at 2026-02-21T01:35:11.683 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 librados: starting objecter 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 Processor -- start 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 -- start start 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 librados: setting wanted keys 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 librados: calling monclient init 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient: init 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient(hunting): picked mon.noname-c con 0x7fc15c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient(hunting): picked mon.noname-b con 0x7fc15c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 10 monclient(hunting): picked mon.noname-a con 0x7fc15c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.665+0000 7fc1642e1640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c127a00 con 0x7fc15c08ddb0 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c127ce0 con 0x7fc15c08d8d0 2026-02-21T01:35:11.684 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15c124ce0 con 0x7fc15c08d4d0 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 monclient(hunting): authenticate will time out at 1043.372007s 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc162056640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fc15c08d4d0 0x7fc15c123ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50370/0 (socket says 10.20.193.43:50370) 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc162056640 1 -- 10.20.193.43:0/4084712007 learned_addr learned my addr 10.20.193.43:0/4084712007 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 client.?.objecter ms_handle_connect 0x7fc15c08d4d0 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 client.?.objecter ms_handle_connect 0x7fc15c08ddb0 2026-02-21T01:35:11.685 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508957309 0 0) 0x7fc15c127a00 con 0x7fc15c08ddb0 2026-02-21T01:35:11.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): my global_id is 25230 2026-02-21T01:35:11.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc12c003610 con 0x7fc15c08ddb0 2026-02-21T01:35:11.686 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148950712 0 0) 0x7fc15c124ce0 con 0x7fc15c08d4d0 2026-02-21T01:35:11.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): my global_id is 104195 2026-02-21T01:35:11.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc15c127a00 con 0x7fc15c08d4d0 2026-02-21T01:35:11.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 client.?.objecter ms_handle_connect 0x7fc15c08d8d0 2026-02-21T01:35:11.687 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.688 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2999257586 0 0) 0x7fc12c003610 con 0x7fc15c08ddb0 2026-02-21T01:35:11.688 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc15c124ce0 con 0x7fc15c08ddb0 2026-02-21T01:35:11.688 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc1580033a0 con 0x7fc15c08ddb0 2026-02-21T01:35:11.688 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.688 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:11.688 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): dump: 2026-02-21T01:35:11.688 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.689 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.689 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.689 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.689 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.689 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.689 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.689 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.690 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.690 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:11.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098919591 0 0) 0x7fc15c127ce0 con 0x7fc15c08d8d0 2026-02-21T01:35:11.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.690 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): my global_id is 84412 2026-02-21T01:35:11.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc12c003610 con 0x7fc15c08d8d0 2026-02-21T01:35:11.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2224819750 0 0) 0x7fc15c127a00 con 0x7fc15c08d4d0 2026-02-21T01:35:11.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc15c127ce0 con 0x7fc15c08d4d0 2026-02-21T01:35:11.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc14c002db0 con 0x7fc15c08d4d0 2026-02-21T01:35:11.691 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.692 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient(hunting): dump: 2026-02-21T01:35:11.692 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.692 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.692 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.692 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.692 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.693 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.693 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.693 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.693 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.693 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3918576476 0 0) 0x7fc15c124ce0 con 0x7fc15c08ddb0 2026-02-21T01:35:11.693 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 >> v1:10.20.193.43:6790/0 conn(0x7fc15c08d4d0 legacy=0x7fc15c123ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 >> v1:10.20.193.46:6789/0 conn(0x7fc15c08d8d0 legacy=0x7fc15c1245d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 monclient: found mon.a 2026-02-21T01:35:11.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c05cd00 con 0x7fc15c08ddb0 2026-02-21T01:35:11.694 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 5 monclient: authenticate success, global_id 25230 2026-02-21T01:35:11.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 monclient: _renew_subs 2026-02-21T01:35:11.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c08c810 con 0x7fc15c08ddb0 2026-02-21T01:35:11.695 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 client.25230.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 monclient: _renew_subs 2026-02-21T01:35:11.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc15c127720 con 0x7fc15c08ddb0 2026-02-21T01:35:11.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 1 librados: init done 2026-02-21T01:35:11.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc158003830 con 0x7fc15c08ddb0 2026-02-21T01:35:11.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.696 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc158003c70 con 0x7fc15c08ddb0 2026-02-21T01:35:11.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.697 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 10 monclient: dump: 2026-02-21T01:35:11.697 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.697 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.697 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.698 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.698 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.698 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.698 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.698 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.698 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.698 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc160853640 4 set_mon_vals no callback set 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 client.25230.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 15 client.25230.objecter _session_command_op_assign -1 1 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 20 client.25230.objecter _get_session osd=-1 returning homeless 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 client.25230.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.43:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc15c08ed90 con 0x7fc15c08ddb0 2026-02-21T01:35:11.699 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.666+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fc158003e90 con 0x7fc15c08ddb0 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7fc15804d1b0 con 0x7fc15c08ddb0 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 10 client.25230.objecter ms_dispatch2 0x7fc15c000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 3 client.25230.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 3 client.25230.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 10 client.25230.objecter checking command 1 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 20 client.25230.objecter _get_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 20 client.25230.objecter put_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.700 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 15 client.25230.objecter _session_command_op_remove -1 1 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 20 client.25230.objecter _get_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 20 client.25230.objecter get_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 15 client.25230.objecter _session_command_op_assign 3 1 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 20 client.25230.objecter put_session s=0x7fc12c064650 osd=3 4 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 10 client.25230.objecter _send_command 1 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.46:6808/3250452844 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc158003150 con 0x7fc12c064d00 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 20 client.25230.objecter dump_active .. 0 homeless 2026-02-21T01:35:11.701 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_get_version_reply(handle=1 version=321) ==== 24+0+0 (unknown 1047129514 0 0) 0x7fc15804d600 con 0x7fc15c08ddb0 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 10 monclient: handle_get_version_reply finishing 1 version 321 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc162056640 10 monclient: get_auth_request con 0x7fc12c03ed40 auth_method 0 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc161855640 10 monclient: get_auth_request con 0x7fc12c064d00 auth_method 0 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 10 client.25230.objecter ms_handle_connect 0x7fc12c03ed40 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.667+0000 7fc142ffd640 10 client.25230.objecter ms_handle_connect 0x7fc12c064d00 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.668+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== osd.3 v1:10.20.193.46:6808/3250452844 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc158003150 con 0x7fc12c064d00 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.668+0000 7fc142ffd640 10 client.25230.objecter ms_dispatch2 0x7fc15c000b90 command_reply(tid 1: 0 ) 2026-02-21T01:35:11.702 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.668+0000 7fc142ffd640 10 client.25230.objecter _finish_command 1 = system:0 2026-02-21T01:35:11.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.668+0000 7fc142ffd640 20 client.25230.objecter put_session s=0x7fc12c064650 osd=3 4 2026-02-21T01:35:11.703 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.668+0000 7fc142ffd640 15 client.25230.objecter _session_command_op_remove 3 1 2026-02-21T01:35:11.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 10 client.25230.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-21T01:35:11.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 15 client.25230.objecter _session_command_op_assign -1 2 2026-02-21T01:35:11.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 client.25230.objecter _get_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 client.25230.objecter put_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.704 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 client.25230.objecter _get_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 15 client.25230.objecter _session_command_op_remove -1 2 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 client.25230.objecter get_session s=0x7fc12c064650 osd=3 3 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 15 client.25230.objecter _session_command_op_assign 3 2 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 client.25230.objecter put_session s=0x7fc12c064650 osd=3 4 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 10 client.25230.objecter _send_command 2 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 --> v1:10.20.193.46:6808/3250452844 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc15c1a10d0 con 0x7fc12c064d00 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc142ffd640 1 -- 10.20.193.43:0/4084712007 <== osd.3 v1:10.20.193.46:6808/3250452844 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc15c1a10d0 con 0x7fc12c064d00 2026-02-21T01:35:11.705 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc142ffd640 10 client.25230.objecter ms_dispatch2 0x7fc15c000b90 command_reply(tid 2: 0 ) 2026-02-21T01:35:11.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc142ffd640 10 client.25230.objecter _finish_command 2 = system:0 2026-02-21T01:35:11.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc142ffd640 20 client.25230.objecter put_session s=0x7fc12c064650 osd=3 4 2026-02-21T01:35:11.706 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc142ffd640 15 client.25230.objecter _session_command_op_remove 3 2 2026-02-21T01:35:11.706 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:11.706 INFO:teuthology.orchestra.run.trial043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-21T01:35:11.707 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 10 librados: watch_flush enter 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 10 librados: watch_flush exit 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 10 client.25230.objecter close_session for osd.3 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 >> v1:10.20.193.46:6808/3250452844 conn(0x7fc12c064d00 legacy=0x7fc12c085190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 client.25230.objecter put_session s=0x7fc12c064650 osd=3 1 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 client.25230.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 10 client.25230.objecter successfully canceled tick 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 >> v1:10.20.193.46:6812/860801619 conn(0x7fc12c03ed40 legacy=0x7fc12c05f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.709 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 10 monclient: shutdown 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 >> v1:10.20.193.43:6789/0 conn(0x7fc15c08ddb0 legacy=0x7fc15c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc162857640 1 -- 10.20.193.43:0/4084712007 reap_dead start 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 shutdown_connections 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 >> 10.20.193.43:0/4084712007 conn(0x7fc15c08f480 msgr2=0x7fc15c086560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 shutdown_connections 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 -- 10.20.193.43:0/4084712007 wait complete. 2026-02-21T01:35:11.710 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.675+0000 7fc1642e1640 1 librados: shutdown 2026-02-21T01:35:11.710 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.776+0000 7feaa33e8640 10 monclient: get_monmap_and_config 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.776+0000 7feaa33e8640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.776+0000 7feaa33e8640 10 monclient: monmap: 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:11.777878+0000 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:11.777878+0000 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.784 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.776+0000 7feaa33e8640 1 Processor -- start 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 1 -- start start 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient: init 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient(hunting): picked mon.noname-c con 0x7fea9c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient(hunting): picked mon.noname-b con 0x7fea9c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient(hunting): picked mon.noname-a con 0x7fea9c08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c08a690 con 0x7fea9c08d8d0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c08b910 con 0x7fea9c08ddb0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c088ae0 con 0x7fea9c08d4d0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient(hunting): authenticate will time out at 1043.483352s 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa195e640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fea9c08d8d0 0x7fea9c19f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51058/0 (socket says 10.20.193.43:51058) 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa195e640 1 -- 10.20.193.43:0/2662748570 learned_addr learned my addr 10.20.193.43:0/2662748570 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa095c640 1 --1- 10.20.193.43:0/2662748570 >> v1:10.20.193.43:6790/0 conn(0x7fea9c08d4d0 0x7fea9c17e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50386/0 (socket says 10.20.193.43:50386) 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872292159 0 0) 0x7fea9c088ae0 con 0x7fea9c08d4d0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): my global_id is 104198 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea84003610 con 0x7fea9c08d4d0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 987397931 0 0) 0x7fea9c08a690 con 0x7fea9c08d8d0 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.785 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient(hunting): my global_id is 25233 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea9c088ae0 con 0x7fea9c08d8d0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4148215266 0 0) 0x7fea84003610 con 0x7fea9c08d4d0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 >> v1:10.20.193.46:6789/0 conn(0x7fea9c08ddb0 legacy=0x7fea9c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 >> v1:10.20.193.43:6789/0 conn(0x7fea9c08d8d0 legacy=0x7fea9c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 monclient: found mon.noname-b 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c1a3ef0 con 0x7fea9c08d4d0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fea90002df0 con 0x7fea9c08d4d0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: dump: 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 5 monclient: authenticate success, global_id 104198 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea900030b0 con 0x7fea9c08d4d0 2026-02-21T01:35:11.786 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 1 -- 10.20.193.43:0/2662748570 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fea900034f0 con 0x7fea9c08d4d0 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7feaa33e8640 4 set_mon_vals no callback set 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.777+0000 7fea8bfff640 10 monclient: dump: 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 10 monclient: shutdown 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 -- 10.20.193.43:0/2662748570 >> v1:10.20.193.43:6790/0 conn(0x7fea9c08d4d0 legacy=0x7fea9c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 -- 10.20.193.43:0/2662748570 shutdown_connections 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 -- 10.20.193.43:0/2662748570 >> 10.20.193.43:0/2662748570 conn(0x7fea9c08f480 msgr2=0x7fea9c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 -- 10.20.193.43:0/2662748570 shutdown_connections 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 -- 10.20.193.43:0/2662748570 wait complete. 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 10 monclient: monmap: 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.787 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 librados: starting msgr at 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 librados: starting objecter 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 Processor -- start 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 -- start start 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 librados: setting wanted keys 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 1 librados: calling monclient init 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.778+0000 7feaa33e8640 10 monclient: init 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient(hunting): picked mon.noname-b con 0x7fea9c08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient(hunting): picked mon.noname-c con 0x7fea9c08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient(hunting): picked mon.noname-a con 0x7fea9c08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c129970 con 0x7fea9c08ddb0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c10c5b0 con 0x7fea9c08d4d0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c087fb0 con 0x7fea9c08d8d0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient(hunting): authenticate will time out at 1043.485112s 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa195e640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fea9c08ddb0 0x7fea9c19b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51064/0 (socket says 10.20.193.43:51064) 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa195e640 1 -- 10.20.193.43:0/4015744454 learned_addr learned my addr 10.20.193.43:0/4015744454 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 client.?.objecter ms_handle_connect 0x7fea9c08ddb0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 client.?.objecter ms_handle_connect 0x7fea9c08d8d0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779644999 0 0) 0x7fea9c129970 con 0x7fea9c08ddb0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): my global_id is 25236 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea6c003610 con 0x7fea9c08ddb0 2026-02-21T01:35:11.788 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2667201023 0 0) 0x7fea9c087fb0 con 0x7fea9c08d8d0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): my global_id is 104201 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea9c129970 con 0x7fea9c08d8d0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 348164888 0 0) 0x7fea6c003610 con 0x7fea9c08ddb0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea9c087fb0 con 0x7fea9c08ddb0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fea980033f0 con 0x7fea9c08ddb0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): dump: 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3017620358 0 0) 0x7fea9c129970 con 0x7fea9c08d8d0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea6c003610 con 0x7fea9c08d8d0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fea90002db0 con 0x7fea9c08d8d0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient(hunting): dump: 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.789 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 client.?.objecter ms_handle_connect 0x7fea9c08d4d0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1423125065 0 0) 0x7fea9c087fb0 con 0x7fea9c08ddb0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 >> v1:10.20.193.43:6790/0 conn(0x7fea9c08d8d0 legacy=0x7fea9c129260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 >> v1:10.20.193.46:6789/0 conn(0x7fea9c08d4d0 legacy=0x7fea9c128b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 monclient: found mon.a 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c10d0d0 con 0x7fea9c08ddb0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 5 monclient: authenticate success, global_id 25236 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _renew_subs 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea9c10d970 con 0x7fea9c08ddb0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea98004c50 con 0x7fea9c08ddb0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 client.25236.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fea98004fa0 con 0x7fea9c08ddb0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea89ffb640 10 monclient: dump: 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.790 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _renew_subs 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7fea8b7fe640 4 set_mon_vals no callback set 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fea9c10c170 con 0x7fea9c08ddb0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 1 librados: init done 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.779+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9c08ed90 con 0x7fea9c08ddb0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fea98011920 con 0x7fea9c08ddb0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7fea9804e360 con 0x7fea9c08ddb0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7fea89ffb640 10 client.25236.objecter ms_dispatch2 0x7fea9c000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7fea89ffb640 3 client.25236.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7fea89ffb640 3 client.25236.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7fea89ffb640 20 client.25236.objecter dump_active .. 0 homeless 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7feaa115d640 10 monclient: get_auth_request con 0x7fea6c03e9a0 auth_method 0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.780+0000 7fea89ffb640 10 client.25236.objecter ms_handle_connect 0x7fea6c03e9a0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.782+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fea98017980 con 0x7fea9c08ddb0 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.782+0000 7fea89ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.791 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.782+0000 7fea89ffb640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:11.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.891+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fea9c10bf60 con 0x7fea6c03e9a0 2026-02-21T01:35:11.893 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7fea89ffb640 1 -- 10.20.193.43:0/4015744454 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fea9c10bf60 con 0x7fea6c03e9a0 2026-02-21T01:35:11.893 INFO:teuthology.orchestra.run.trial043.stderr:instructed osd(s) 3 to deep-scrub 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 10 librados: watch_flush enter 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 10 librados: watch_flush exit 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 20 client.25236.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 10 client.25236.objecter successfully canceled tick 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 >> v1:10.20.193.46:6812/860801619 conn(0x7fea6c03e9a0 legacy=0x7fea6c05ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 10 monclient: shutdown 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 >> v1:10.20.193.43:6789/0 conn(0x7fea9c08ddb0 legacy=0x7fea9c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 shutdown_connections 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 >> 10.20.193.43:0/4015744454 conn(0x7fea9c08f480 msgr2=0x7fea9c1a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 shutdown_connections 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 1 -- 10.20.193.43:0/4015744454 wait complete. 2026-02-21T01:35:11.894 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.892+0000 7feaa33e8640 1 librados: shutdown 2026-02-21T01:35:11.902 INFO:tasks.ceph:Scrubbing osd.4 2026-02-21T01:35:11.902 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-21T01:35:11.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.969+0000 7f86d2f7f640 10 monclient: get_monmap_and_config 2026-02-21T01:35:11.970 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.969+0000 7f86d2f7f640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.969+0000 7f86d2f7f640 10 monclient: monmap: 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:11.970713+0000 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:11.970713+0000 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:11.971 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.969+0000 7f86d2f7f640 1 Processor -- start 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.969+0000 7f86d2f7f640 1 -- start start 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.969+0000 7f86d2f7f640 10 monclient: init 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient(hunting): picked mon.noname-b con 0x7f86cc08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient(hunting): picked mon.noname-a con 0x7f86cc08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient(hunting): picked mon.noname-c con 0x7f86cc08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc08a690 con 0x7f86cc08d4d0 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc08b910 con 0x7f86cc08d8d0 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc088ae0 con 0x7f86cc08ddb0 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient(hunting): authenticate will time out at 1043.676151s 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d0cf4640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f86cc08ddb0 0x7f86cc08e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50402/0 (socket says 10.20.193.43:50402) 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d0cf4640 1 -- 10.20.193.43:0/1966375900 learned_addr learned my addr 10.20.193.43:0/1966375900 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292046837 0 0) 0x7f86cc08a690 con 0x7f86cc08d4d0 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.974 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): my global_id is 25239 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86b8003610 con 0x7f86cc08d4d0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334050283 0 0) 0x7f86cc088ae0 con 0x7f86cc08ddb0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient(hunting): my global_id is 104204 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86cc08a690 con 0x7f86cc08ddb0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 220495001 0 0) 0x7f86b8003610 con 0x7f86cc08d4d0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 >> v1:10.20.193.43:6790/0 conn(0x7f86cc08ddb0 legacy=0x7f86cc08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 >> v1:10.20.193.46:6789/0 conn(0x7f86cc08d8d0 legacy=0x7f86cc19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 monclient: found mon.noname-a 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc1a3ef0 con 0x7f86cc08d4d0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f86b4002df0 con 0x7f86cc08d4d0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: dump: 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.975 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 5 monclient: authenticate success, global_id 25239 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86b40030f0 con 0x7f86cc08d4d0 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 1 -- 10.20.193.43:0/1966375900 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f86b4003530 con 0x7f86cc08d4d0 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86c37fe640 10 monclient: dump: 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 4 set_mon_vals no callback set 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 10 monclient: shutdown 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- 10.20.193.43:0/1966375900 >> v1:10.20.193.43:6789/0 conn(0x7f86cc08d4d0 legacy=0x7f86cc17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- 10.20.193.43:0/1966375900 shutdown_connections 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- 10.20.193.43:0/1966375900 >> 10.20.193.43:0/1966375900 conn(0x7f86cc08f480 msgr2=0x7f86cc08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- 10.20.193.43:0/1966375900 shutdown_connections 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.970+0000 7f86d2f7f640 1 -- 10.20.193.43:0/1966375900 wait complete. 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient: build_initial_monmap 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient: monmap: 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:11.976 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 librados: starting msgr at 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 librados: starting objecter 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 Processor -- start 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 -- start start 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 librados: setting wanted keys 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 librados: calling monclient init 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient: init 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient(hunting): picked mon.noname-b con 0x7f86cc08d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient(hunting): picked mon.noname-c con 0x7f86cc08d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient(hunting): picked mon.noname-a con 0x7f86cc08ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc05c350 con 0x7f86cc08ddb0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc087380 con 0x7f86cc08d4d0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc0572c0 con 0x7f86cc08d8d0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86d2f7f640 10 monclient(hunting): authenticate will time out at 1043.677733s 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c3fff640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f86cc08d8d0 0x7f86cc086c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50414/0 (socket says 10.20.193.43:50414) 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c3fff640 1 -- 10.20.193.43:0/4075008981 learned_addr learned my addr 10.20.193.43:0/4075008981 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 client.?.objecter ms_handle_connect 0x7f86cc08d8d0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 client.?.objecter ms_handle_connect 0x7f86cc08ddb0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498389425 0 0) 0x7f86cc0572c0 con 0x7f86cc08d8d0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): my global_id is 104207 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f869c003610 con 0x7f86cc08d8d0 2026-02-21T01:35:11.977 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647483784 0 0) 0x7f86cc05c350 con 0x7f86cc08ddb0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): my global_id is 25242 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86cc0572c0 con 0x7f86cc08ddb0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3518618875 0 0) 0x7f869c003610 con 0x7f86cc08d8d0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86cc05c350 con 0x7f86cc08d8d0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f86b4003440 con 0x7f86cc08d8d0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): dump: 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.971+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 88936168 0 0) 0x7f86cc0572c0 con 0x7f86cc08ddb0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f869c003610 con 0x7f86cc08ddb0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f86c8003310 con 0x7f86cc08ddb0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient(hunting): dump: 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.978 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 457724798 0 0) 0x7f86cc05c350 con 0x7f86cc08d8d0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 >> v1:10.20.193.46:6789/0 conn(0x7f86cc08d4d0 legacy=0x7f86cc086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 >> v1:10.20.193.43:6789/0 conn(0x7f86cc08ddb0 legacy=0x7f86cc18ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: _finish_hunting 0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 monclient: found mon.c 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc10a920 con 0x7f86cc08d8d0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: _finish_auth 0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: _check_auth_tickets 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 5 monclient: authenticate success, global_id 104207 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 monclient: _renew_subs 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f86cc05e190 con 0x7f86cc08d8d0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 client.104207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 monclient: _renew_subs 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f86cc05bbb0 con 0x7f86cc08d8d0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 1 librados: init done 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86b4003b00 con 0x7f86cc08d8d0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f86b4003ed0 con 0x7f86cc08d8d0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: dump: 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:11.979 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c2ffd640 4 set_mon_vals no callback set 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 client.104207.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 15 client.104207.objecter _session_command_op_assign -1 1 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 20 client.104207.objecter _get_session osd=-1 returning homeless 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 client.104207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.43:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f86cc10a190 con 0x7f86cc08d8d0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f86b4004070 con 0x7f86cc08d8d0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f86b404e0c0 con 0x7f86cc08d8d0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 client.104207.objecter ms_dispatch2 0x7f86cc000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 3 client.104207.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 3 client.104207.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 client.104207.objecter checking command 1 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 client.104207.objecter _get_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 client.104207.objecter put_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 15 client.104207.objecter _session_command_op_remove -1 1 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 client.104207.objecter _get_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 client.104207.objecter get_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 15 client.104207.objecter _session_command_op_assign 4 1 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 client.104207.objecter put_session s=0x7f869c064370 osd=4 4 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 client.104207.objecter _send_command 1 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.46:6802/3807500891 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f869c086720 con 0x7f869c064a20 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 20 client.104207.objecter dump_active .. 0 homeless 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_get_version_reply(handle=1 version=321) ==== 24+0+0 (unknown 1047129514 0 0) 0x7f86b404e510 con 0x7f86cc08d8d0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86c17fa640 10 monclient: handle_get_version_reply finishing 1 version 321 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.972+0000 7f86d0cf4640 10 monclient: get_auth_request con 0x7f869c03ea00 auth_method 0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86d14f5640 10 monclient: get_auth_request con 0x7f869c064a20 auth_method 0 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86c17fa640 10 client.104207.objecter ms_handle_connect 0x7f869c03ea00 2026-02-21T01:35:11.980 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86c17fa640 10 client.104207.objecter ms_handle_connect 0x7f869c064a20 2026-02-21T01:35:11.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== osd.4 v1:10.20.193.46:6802/3807500891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f869c086720 con 0x7f869c064a20 2026-02-21T01:35:11.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86c17fa640 10 client.104207.objecter ms_dispatch2 0x7f86cc000b90 command_reply(tid 1: 0 ) 2026-02-21T01:35:11.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86c17fa640 10 client.104207.objecter _finish_command 1 = system:0 2026-02-21T01:35:11.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86c17fa640 20 client.104207.objecter put_session s=0x7f869c064370 osd=4 4 2026-02-21T01:35:11.981 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.973+0000 7f86c17fa640 15 client.104207.objecter _session_command_op_remove 4 1 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 10 client.104207.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 15 client.104207.objecter _session_command_op_assign -1 2 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 20 client.104207.objecter _get_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 20 client.104207.objecter put_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 20 client.104207.objecter _get_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 15 client.104207.objecter _session_command_op_remove -1 2 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 20 client.104207.objecter get_session s=0x7f869c064370 osd=4 3 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 15 client.104207.objecter _session_command_op_assign 4 2 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 20 client.104207.objecter put_session s=0x7f869c064370 osd=4 4 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 10 client.104207.objecter _send_command 2 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.980+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 --> v1:10.20.193.46:6802/3807500891 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f86cc08edb0 con 0x7f869c064a20 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86c17fa640 1 -- 10.20.193.43:0/4075008981 <== osd.4 v1:10.20.193.46:6802/3807500891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f86cc08edb0 con 0x7f869c064a20 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86c17fa640 10 client.104207.objecter ms_dispatch2 0x7f86cc000b90 command_reply(tid 2: 0 ) 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86c17fa640 10 client.104207.objecter _finish_command 2 = system:0 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86c17fa640 20 client.104207.objecter put_session s=0x7f869c064370 osd=4 4 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86c17fa640 15 client.104207.objecter _session_command_op_remove 4 2 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-21T01:35:11.982 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 10 librados: watch_flush enter 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 10 librados: watch_flush exit 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 10 client.104207.objecter close_session for osd.4 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 >> v1:10.20.193.46:6802/3807500891 conn(0x7f869c064a20 legacy=0x7f869c084eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 20 client.104207.objecter put_session s=0x7f869c064370 osd=4 1 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 20 client.104207.objecter shutdown clearing up homeless session... 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 10 client.104207.objecter successfully canceled tick 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 >> v1:10.20.193.46:6812/860801619 conn(0x7f869c03ea00 legacy=0x7f869c05eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 10 monclient: shutdown 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 >> v1:10.20.193.43:6790/0 conn(0x7f86cc08d8d0 legacy=0x7f86cc086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d14f5640 1 -- 10.20.193.43:0/4075008981 reap_dead start 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 shutdown_connections 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 >> 10.20.193.43:0/4075008981 conn(0x7f86cc08f480 msgr2=0x7f86cc11ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 shutdown_connections 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 -- 10.20.193.43:0/4075008981 wait complete. 2026-02-21T01:35:11.983 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:11.981+0000 7f86d2f7f640 1 librados: shutdown 2026-02-21T01:35:11.988 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-21T01:35:12.055 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient: get_monmap_and_config 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient: monmap: 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:12.055532+0000 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:12.055532+0000 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 1 Processor -- start 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 1 -- start start 2026-02-21T01:35:12.056 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient: init 2026-02-21T01:35:12.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:12.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient(hunting): picked mon.noname-c con 0x7f219c08ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.061 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient(hunting): picked mon.noname-b con 0x7f219c08d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient(hunting): picked mon.noname-a con 0x7f219c08d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c08a690 con 0x7f219c08d8d0 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c08b910 con 0x7f219c08ddb0 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c088ae0 con 0x7f219c08d4d0 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.054+0000 7f21a2a82640 10 monclient(hunting): authenticate will time out at 1043.760980s 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a0ff8640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f219c08d8d0 0x7f219c19f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51084/0 (socket says 10.20.193.43:51084) 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a0ff8640 1 -- 10.20.193.43:0/1195898028 learned_addr learned my addr 10.20.193.43:0/1195898028 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415423574 0 0) 0x7f219c08a690 con 0x7f219c08d8d0 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): my global_id is 25245 2026-02-21T01:35:12.062 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2180003610 con 0x7f219c08d8d0 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171568746 0 0) 0x7f219c088ae0 con 0x7f219c08d4d0 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient(hunting): my global_id is 104210 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f219c08a690 con 0x7f219c08d4d0 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3383147122 0 0) 0x7f2180003610 con 0x7f219c08d8d0 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 >> v1:10.20.193.43:6790/0 conn(0x7f219c08d4d0 legacy=0x7f219c17e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 >> v1:10.20.193.46:6789/0 conn(0x7f219c08ddb0 legacy=0x7f219c08e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 monclient: found mon.noname-a 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c1a3ef0 con 0x7f219c08d8d0 2026-02-21T01:35:12.063 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 5 monclient: authenticate success, global_id 25245 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2190003170 con 0x7f219c08d8d0 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: dump: 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.064 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21900033f0 con 0x7f219c08d8d0 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 4 set_mon_vals no callback set 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 1 -- 10.20.193.43:0/1195898028 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2190003830 con 0x7f219c08d8d0 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f219affd640 10 monclient: dump: 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.065 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 10 monclient: shutdown 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 1 -- 10.20.193.43:0/1195898028 >> v1:10.20.193.43:6789/0 conn(0x7f219c08d8d0 legacy=0x7f219c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 1 -- 10.20.193.43:0/1195898028 shutdown_connections 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 1 -- 10.20.193.43:0/1195898028 >> 10.20.193.43:0/1195898028 conn(0x7f219c08f480 msgr2=0x7f219c08f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 1 -- 10.20.193.43:0/1195898028 shutdown_connections 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.055+0000 7f21a2a82640 1 -- 10.20.193.43:0/1195898028 wait complete. 2026-02-21T01:35:12.066 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient: monmap: 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 librados: starting msgr at 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 librados: starting objecter 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 Processor -- start 2026-02-21T01:35:12.067 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 -- start start 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 librados: setting wanted keys 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 librados: calling monclient init 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient: init 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient(hunting): picked mon.noname-a con 0x7f219c08d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient(hunting): picked mon.noname-b con 0x7f219c08d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient(hunting): picked mon.noname-c con 0x7f219c08ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c10e240 con 0x7f219c08d4d0 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c057780 con 0x7f219c08d8d0 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c087380 con 0x7f219c08ddb0 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f21a2a82640 10 monclient(hunting): authenticate will time out at 1043.762764s 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f219bfff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f219c08d4d0 0x7f219c086560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51094/0 (socket says 10.20.193.43:51094) 2026-02-21T01:35:12.068 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f219bfff640 1 -- 10.20.193.43:0/2107364915 learned_addr learned my addr 10.20.193.43:0/2107364915 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 client.?.objecter ms_handle_connect 0x7f219c08ddb0 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 client.?.objecter ms_handle_connect 0x7f219c08d4d0 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833689415 0 0) 0x7f219c087380 con 0x7f219c08ddb0 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): my global_id is 104213 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f216c003610 con 0x7f219c08ddb0 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648002498 0 0) 0x7f219c08b910 con 0x7f219c08d4d0 2026-02-21T01:35:12.069 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): my global_id is 25248 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f219c087380 con 0x7f219c08d4d0 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 client.?.objecter ms_handle_connect 0x7f219c08d8d0 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701066432 0 0) 0x7f219c08a690 con 0x7f219c08d8d0 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.056+0000 7f2198ff9640 10 monclient(hunting): my global_id is 84421 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f219c08b910 con 0x7f219c08d8d0 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2023196882 0 0) 0x7f216c003610 con 0x7f219c08ddb0 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f219c08a690 con 0x7f219c08ddb0 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2190002ee0 con 0x7f219c08ddb0 2026-02-21T01:35:12.070 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2375232408 0 0) 0x7f219c087380 con 0x7f219c08d4d0 2026-02-21T01:35:12.071 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f216c003610 con 0x7f219c08d4d0 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2188003110 con 0x7f219c08d4d0 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient(hunting): dump: 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.072 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 350903467 0 0) 0x7f219c08a690 con 0x7f219c08ddb0 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 >> v1:10.20.193.46:6789/0 conn(0x7f219c08d8d0 legacy=0x7f219c086c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 >> v1:10.20.193.43:6789/0 conn(0x7f219c08d4d0 legacy=0x7f219c086560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 monclient: found mon.c 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c05e1b0 con 0x7f219c08ddb0 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 5 monclient: authenticate success, global_id 104213 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 monclient: _renew_subs 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f219c088000 con 0x7f219c08ddb0 2026-02-21T01:35:12.073 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2190004e30 con 0x7f219c08ddb0 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 client.104213.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 monclient: _renew_subs 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f219c10de20 con 0x7f219c08ddb0 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f2190005180 con 0x7f219c08ddb0 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 1 librados: init done 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f219a7fc640 4 set_mon_vals no callback set 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 monclient: dump: 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.074 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c11f800 con 0x7f219c08ddb0 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f2190011b00 con 0x7f219c08ddb0 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f219004e260 con 0x7f219c08ddb0 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 10 client.104213.objecter ms_dispatch2 0x7f219c000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 3 client.104213.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 3 client.104213.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:12.075 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f2198ff9640 20 client.104213.objecter dump_active .. 0 homeless 2026-02-21T01:35:12.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.057+0000 7f219bfff640 10 monclient: get_auth_request con 0x7f216c03eb20 auth_method 0 2026-02-21T01:35:12.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.058+0000 7f2198ff9640 10 client.104213.objecter ms_handle_connect 0x7f216c03eb20 2026-02-21T01:35:12.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.059+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2190017940 con 0x7f219c08ddb0 2026-02-21T01:35:12.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.059+0000 7f2198ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.076 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.059+0000 7f2198ff9640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:12.168 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.166+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f219c08edd0 con 0x7f216c03eb20 2026-02-21T01:35:12.169 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f2198ff9640 1 -- 10.20.193.43:0/2107364915 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f219c08edd0 con 0x7f216c03eb20 2026-02-21T01:35:12.169 INFO:teuthology.orchestra.run.trial043.stderr:instructed osd(s) 4 to deep-scrub 2026-02-21T01:35:12.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 10 librados: watch_flush enter 2026-02-21T01:35:12.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 10 librados: watch_flush exit 2026-02-21T01:35:12.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 20 client.104213.objecter shutdown clearing up homeless session... 2026-02-21T01:35:12.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 10 client.104213.objecter successfully canceled tick 2026-02-21T01:35:12.170 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 >> v1:10.20.193.46:6812/860801619 conn(0x7f216c03eb20 legacy=0x7f216c05efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 10 monclient: shutdown 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 >> v1:10.20.193.43:6790/0 conn(0x7f219c08ddb0 legacy=0x7f219c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 shutdown_connections 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.167+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 >> 10.20.193.43:0/2107364915 conn(0x7f219c08f480 msgr2=0x7f219c058600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.168+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 shutdown_connections 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.168+0000 7f21a2a82640 1 -- 10.20.193.43:0/2107364915 wait complete. 2026-02-21T01:35:12.171 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.168+0000 7f21a2a82640 1 librados: shutdown 2026-02-21T01:35:12.177 INFO:tasks.ceph:Scrubbing osd.5 2026-02-21T01:35:12.177 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-21T01:35:12.247 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.246+0000 7f6425ca7640 10 monclient: get_monmap_and_config 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.246+0000 7f6425ca7640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.246+0000 7f6425ca7640 10 monclient: monmap: 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:12.247453+0000 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:12.247453+0000 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.248 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:12.249 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:12.249 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.258 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.246+0000 7f6425ca7640 1 Processor -- start 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.246+0000 7f6425ca7640 1 -- start start 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.246+0000 7f6425ca7640 10 monclient: init 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient(hunting): picked mon.noname-a con 0x7f6420058260 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient(hunting): picked mon.noname-c con 0x7f6420057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient(hunting): picked mon.noname-b con 0x7f6420181e80 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420056c50 con 0x7f6420058260 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642008eda0 con 0x7f6420057630 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642008f5c0 con 0x7f6420181e80 2026-02-21T01:35:12.259 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient(hunting): authenticate will time out at 1043.953139s 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641f7fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6420058260 0x7f642008df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51108/0 (socket says 10.20.193.43:51108) 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641f7fe640 1 -- 10.20.193.43:0/793366021 learned_addr learned my addr 10.20.193.43:0/793366021 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760446528 0 0) 0x7f6420056c50 con 0x7f6420058260 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): my global_id is 25251 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6404003610 con 0x7f6420058260 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130471893 0 0) 0x7f642008f5c0 con 0x7f6420181e80 2026-02-21T01:35:12.260 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient(hunting): my global_id is 104216 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6420056c50 con 0x7f6420181e80 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3060946821 0 0) 0x7f6404003610 con 0x7f6420058260 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 >> v1:10.20.193.43:6790/0 conn(0x7f6420181e80 legacy=0x7f64201a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 >> v1:10.20.193.46:6789/0 conn(0x7f6420057630 legacy=0x7f642008e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 monclient: found mon.noname-a 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.261 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64200563b0 con 0x7f6420058260 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f640c002df0 con 0x7f6420058260 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 5 monclient: authenticate success, global_id 25251 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: dump: 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.262 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f640c003040 con 0x7f6420058260 2026-02-21T01:35:12.263 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 1 -- 10.20.193.43:0/793366021 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f640c003480 con 0x7f6420058260 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 4 set_mon_vals no callback set 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f641e7fc640 10 monclient: dump: 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.264 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 10 monclient: shutdown 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- 10.20.193.43:0/793366021 >> v1:10.20.193.43:6789/0 conn(0x7f6420058260 legacy=0x7f642008df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- 10.20.193.43:0/793366021 shutdown_connections 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- 10.20.193.43:0/793366021 >> 10.20.193.43:0/793366021 conn(0x7f6420090360 msgr2=0x7f6420090760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.265 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- 10.20.193.43:0/793366021 shutdown_connections 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.247+0000 7f6425ca7640 1 -- 10.20.193.43:0/793366021 wait complete. 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient: monmap: 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.266 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 librados: starting msgr at 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 librados: starting objecter 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 Processor -- start 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 -- start start 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 librados: setting wanted keys 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 librados: calling monclient init 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient: init 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.267 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient(hunting): picked mon.noname-b con 0x7f6420057630 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient(hunting): picked mon.noname-c con 0x7f6420058260 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient(hunting): picked mon.noname-a con 0x7f6420181e80 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642014cc30 con 0x7f6420181e80 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420149920 con 0x7f6420057630 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642012fd00 con 0x7f6420058260 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f6425ca7640 10 monclient(hunting): authenticate will time out at 1043.954816s 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f641ffff640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f6420181e80 0x7f6420171ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51124/0 (socket says 10.20.193.43:51124) 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f641ffff640 1 -- 10.20.193.43:0/3578896007 learned_addr learned my addr 10.20.193.43:0/3578896007 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 client.?.objecter ms_handle_connect 0x7f6420058260 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.268 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 client.?.objecter ms_handle_connect 0x7f6420181e80 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382521091 0 0) 0x7f642014cc30 con 0x7f6420181e80 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): my global_id is 25254 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63f0003610 con 0x7f6420181e80 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639855877 0 0) 0x7f642012fd00 con 0x7f6420058260 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.269 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 10 monclient(hunting): my global_id is 104219 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.248+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642014cc30 con 0x7f6420058260 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2131590554 0 0) 0x7f63f0003610 con 0x7f6420181e80 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f642012fd00 con 0x7f6420181e80 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f64140033b0 con 0x7f6420181e80 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient(hunting): dump: 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.270 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 client.?.objecter ms_handle_connect 0x7f6420057630 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 133622326 0 0) 0x7f642014cc30 con 0x7f6420058260 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63f0003610 con 0x7f6420058260 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6410002fe0 con 0x7f6420058260 2026-02-21T01:35:12.271 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient(hunting): dump: 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.272 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3301545624 0 0) 0x7f642012fd00 con 0x7f6420181e80 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 >> v1:10.20.193.43:6790/0 conn(0x7f6420058260 legacy=0x7f64201705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 >> v1:10.20.193.46:6789/0 conn(0x7f6420057630 legacy=0x7f6420149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 monclient: found mon.a 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642008a870 con 0x7f6420181e80 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.273 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 5 monclient: authenticate success, global_id 25254 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 monclient: _renew_subs 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f642012e810 con 0x7f6420181e80 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 client.25254.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 monclient: _renew_subs 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f642012f370 con 0x7f6420181e80 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 1 librados: init done 2026-02-21T01:35:12.274 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64140037e0 con 0x7f6420181e80 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f6414003ed0 con 0x7f6420181e80 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 monclient: dump: 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.275 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f641dffb640 4 set_mon_vals no callback set 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 client.25254.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 15 client.25254.objecter _session_command_op_assign -1 1 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 20 client.25254.objecter _get_session osd=-1 returning homeless 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 client.25254.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.276 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.43:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f64200008d0 con 0x7f6420181e80 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f64140040f0 con 0x7f6420181e80 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f641404e420 con 0x7f6420181e80 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 10 client.25254.objecter ms_dispatch2 0x7f6420000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 3 client.25254.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.249+0000 7f63fbfff640 3 client.25254.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 10 client.25254.objecter checking command 1 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 20 client.25254.objecter _get_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 20 client.25254.objecter put_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 15 client.25254.objecter _session_command_op_remove -1 1 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 20 client.25254.objecter _get_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 20 client.25254.objecter get_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 15 client.25254.objecter _session_command_op_assign 5 1 2026-02-21T01:35:12.277 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 20 client.25254.objecter put_session s=0x7f63f00642f0 osd=5 4 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 10 client.25254.objecter _send_command 1 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.46:6800/1266691672 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63f00866a0 con 0x7f63f00649a0 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 20 client.25254.objecter dump_active .. 0 homeless 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_get_version_reply(handle=1 version=321) ==== 24+0+0 (unknown 1047129514 0 0) 0x7f641404e870 con 0x7f6420181e80 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 10 monclient: handle_get_version_reply finishing 1 version 321 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f641f7fe640 10 monclient: get_auth_request con 0x7f63f003e980 auth_method 0 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f641effd640 10 monclient: get_auth_request con 0x7f63f00649a0 auth_method 0 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 10 client.25254.objecter ms_handle_connect 0x7f63f003e980 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 10 client.25254.objecter ms_handle_connect 0x7f63f00649a0 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== osd.5 v1:10.20.193.46:6800/1266691672 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f63f00866a0 con 0x7f63f00649a0 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 10 client.25254.objecter ms_dispatch2 0x7f6420000b90 command_reply(tid 1: 0 ) 2026-02-21T01:35:12.278 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 10 client.25254.objecter _finish_command 1 = system:0 2026-02-21T01:35:12.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 20 client.25254.objecter put_session s=0x7f63f00642f0 osd=5 4 2026-02-21T01:35:12.279 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.250+0000 7f63fbfff640 15 client.25254.objecter _session_command_op_remove 5 1 2026-02-21T01:35:12.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 10 client.25254.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-21T01:35:12.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 15 client.25254.objecter _session_command_op_assign -1 2 2026-02-21T01:35:12.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 20 client.25254.objecter _get_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 20 client.25254.objecter put_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 20 client.25254.objecter _get_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.280 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 15 client.25254.objecter _session_command_op_remove -1 2 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 20 client.25254.objecter get_session s=0x7f63f00642f0 osd=5 3 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 15 client.25254.objecter _session_command_op_assign 5 2 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 20 client.25254.objecter put_session s=0x7f63f00642f0 osd=5 4 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 10 client.25254.objecter _send_command 2 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 --> v1:10.20.193.46:6800/1266691672 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f642014c140 con 0x7f63f00649a0 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f63fbfff640 1 -- 10.20.193.43:0/3578896007 <== osd.5 v1:10.20.193.46:6800/1266691672 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f642014c140 con 0x7f63f00649a0 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f63fbfff640 10 client.25254.objecter ms_dispatch2 0x7f6420000b90 command_reply(tid 2: 0 ) 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f63fbfff640 10 client.25254.objecter _finish_command 2 = system:0 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f63fbfff640 20 client.25254.objecter put_session s=0x7f63f00642f0 osd=5 4 2026-02-21T01:35:12.281 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f63fbfff640 15 client.25254.objecter _session_command_op_remove 5 2 2026-02-21T01:35:12.282 INFO:teuthology.orchestra.run.trial043.stdout:{ 2026-02-21T01:35:12.282 INFO:teuthology.orchestra.run.trial043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-21T01:35:12.282 INFO:teuthology.orchestra.run.trial043.stdout:} 2026-02-21T01:35:12.284 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 10 librados: watch_flush enter 2026-02-21T01:35:12.284 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.257+0000 7f6425ca7640 10 librados: watch_flush exit 2026-02-21T01:35:12.284 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 10 client.25254.objecter close_session for osd.5 2026-02-21T01:35:12.284 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 >> v1:10.20.193.46:6800/1266691672 conn(0x7f63f00649a0 legacy=0x7f63f0084e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.284 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 20 client.25254.objecter put_session s=0x7f63f00642f0 osd=5 1 2026-02-21T01:35:12.284 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 20 client.25254.objecter shutdown clearing up homeless session... 2026-02-21T01:35:12.284 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 10 client.25254.objecter successfully canceled tick 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 >> v1:10.20.193.46:6812/860801619 conn(0x7f63f003e980 legacy=0x7f63f005ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 10 monclient: shutdown 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 >> v1:10.20.193.43:6789/0 conn(0x7f6420181e80 legacy=0x7f6420171ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f641ffff640 1 -- 10.20.193.43:0/3578896007 reap_dead start 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 shutdown_connections 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 >> 10.20.193.43:0/3578896007 conn(0x7f6420090360 msgr2=0x7f642008aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 shutdown_connections 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 -- 10.20.193.43:0/3578896007 wait complete. 2026-02-21T01:35:12.285 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.258+0000 7f6425ca7640 1 librados: shutdown 2026-02-21T01:35:12.286 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-21T01:35:12.362 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.352+0000 7fc391a28640 10 monclient: get_monmap_and_config 2026-02-21T01:35:12.362 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.352+0000 7fc391a28640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.362 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.352+0000 7fc391a28640 10 monclient: monmap: 2026-02-21T01:35:12.362 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.362 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.362 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:12.353765+0000 2026-02-21T01:35:12.362 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:12.353765+0000 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.352+0000 7fc391a28640 1 Processor -- start 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.352+0000 7fc391a28640 1 -- start start 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.352+0000 7fc391a28640 10 monclient: init 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-21T01:35:12.363 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient(hunting): picked mon.noname-b con 0x7fc38c139e10 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient(hunting): picked mon.noname-c con 0x7fc38c13a1e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient(hunting): picked mon.noname-a con 0x7fc38c17fdc0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c088b10 con 0x7fc38c17fdc0 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c13d860 con 0x7fc38c13a1e0 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c08a550 con 0x7fc38c139e10 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient(hunting): authenticate will time out at 1044.059185s 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391227640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc38c17fdc0 0x7fc38c1a01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51128/0 (socket says 10.20.193.43:51128) 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc390a26640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7fc38c139e10 0x7fc38c13ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50464/0 (socket says 10.20.193.43:50464) 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391227640 1 -- 10.20.193.43:0/2590843279 learned_addr learned my addr 10.20.193.43:0/2590843279 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.364 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051732948 0 0) 0x7fc38c088b10 con 0x7fc38c17fdc0 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): my global_id is 25257 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc378003610 con 0x7fc38c17fdc0 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410530038 0 0) 0x7fc38c08a550 con 0x7fc38c139e10 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.365 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient(hunting): my global_id is 104222 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc38c088b10 con 0x7fc38c139e10 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 614954304 0 0) 0x7fc38c088b10 con 0x7fc38c139e10 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 >> v1:10.20.193.46:6789/0 conn(0x7fc38c13a1e0 legacy=0x7fc38c13d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 >> v1:10.20.193.43:6789/0 conn(0x7fc38c17fdc0 legacy=0x7fc38c1a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 monclient: found mon.noname-b 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c08a830 con 0x7fc38c139e10 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.366 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc37c002df0 con 0x7fc38c139e10 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: dump: 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.367 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 5 monclient: authenticate success, global_id 104222 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc37c002fc0 con 0x7fc38c139e10 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 4 set_mon_vals no callback set 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 1 -- 10.20.193.43:0/2590843279 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc37c003380 con 0x7fc38c139e10 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc3837fe640 10 monclient: dump: 2026-02-21T01:35:12.368 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 10 monclient: shutdown 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.369 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- 10.20.193.43:0/2590843279 >> v1:10.20.193.43:6790/0 conn(0x7fc38c139e10 legacy=0x7fc38c13ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- 10.20.193.43:0/2590843279 shutdown_connections 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- 10.20.193.43:0/2590843279 >> 10.20.193.43:0/2590843279 conn(0x7fc38c08f620 msgr2=0x7fc38c08baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- 10.20.193.43:0/2590843279 shutdown_connections 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.353+0000 7fc391a28640 1 -- 10.20.193.43:0/2590843279 wait complete. 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient: monmap: 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.370 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 librados: starting msgr at 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 librados: starting objecter 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 Processor -- start 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 -- start start 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 librados: setting wanted keys 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 librados: calling monclient init 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient: init 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.371 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient(hunting): picked mon.noname-a con 0x7fc38c139e10 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient(hunting): picked mon.noname-b con 0x7fc38c13a1e0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient(hunting): picked mon.noname-c con 0x7fc38c17fdc0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c128200 con 0x7fc38c139e10 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c1284e0 con 0x7fc38c13a1e0 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38c14dad0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc391a28640 10 monclient(hunting): authenticate will time out at 1044.060947s 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc390a26640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fc38c139e10 0x7fc38c14ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51136/0 (socket says 10.20.193.43:51136) 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.354+0000 7fc390a26640 1 -- 10.20.193.43:0/2162852879 learned_addr learned my addr 10.20.193.43:0/2162852879 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 client.?.objecter ms_handle_connect 0x7fc38c139e10 2026-02-21T01:35:12.372 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 client.?.objecter ms_handle_connect 0x7fc38c17fdc0 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893980583 0 0) 0x7fc38c128200 con 0x7fc38c139e10 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): my global_id is 25260 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc35c003610 con 0x7fc38c139e10 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 287118602 0 0) 0x7fc38c14dad0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.373 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): my global_id is 104225 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc38c128200 con 0x7fc38c17fdc0 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 client.?.objecter ms_handle_connect 0x7fc38c13a1e0 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 753277205 0 0) 0x7fc38c128200 con 0x7fc38c17fdc0 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc38c14dad0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4071379337 0 0) 0x7fc35c003610 con 0x7fc38c139e10 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc38c128200 con 0x7fc38c139e10 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc388002c30 con 0x7fc38c17fdc0 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): dump: 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.374 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc37c003310 con 0x7fc38c139e10 2026-02-21T01:35:12.375 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient(hunting): dump: 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.376 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1995929917 0 0) 0x7fc38c14dad0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 >> v1:10.20.193.46:6789/0 conn(0x7fc38c13a1e0 legacy=0x7fc38c14d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 >> v1:10.20.193.43:6789/0 conn(0x7fc38c139e10 legacy=0x7fc38c14ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 monclient: found mon.c 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c08e7c0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.377 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 5 monclient: authenticate success, global_id 104225 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 monclient: _renew_subs 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c05e170 con 0x7fc38c17fdc0 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc388004c50 con 0x7fc38c17fdc0 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 client.104225.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fc388004fa0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 10 monclient: dump: 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.378 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc382ffd640 4 set_mon_vals no callback set 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 monclient: _renew_subs 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc38c1374c0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 1 librados: init done 2026-02-21T01:35:12.379 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.43:6790/0 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.43:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38c0894c0 con 0x7fc38c17fdc0 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.355+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fc388011920 con 0x7fc38c17fdc0 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.356+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7fc38804e200 con 0x7fc38c17fdc0 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.356+0000 7fc3817fa640 10 client.104225.objecter ms_dispatch2 0x7fc38c000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.356+0000 7fc3817fa640 3 client.104225.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.356+0000 7fc3817fa640 3 client.104225.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.356+0000 7fc3817fa640 20 client.104225.objecter dump_active .. 0 homeless 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.356+0000 7fc390a26640 10 monclient: get_auth_request con 0x7fc35c03ea30 auth_method 0 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.356+0000 7fc3817fa640 10 client.104225.objecter ms_handle_connect 0x7fc35c03ea30 2026-02-21T01:35:12.380 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.358+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mon.2 v1:10.20.193.43:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc388017940 con 0x7fc38c17fdc0 2026-02-21T01:35:12.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.358+0000 7fc3817fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.381 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.358+0000 7fc3817fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:12.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.464+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc38c054e20 con 0x7fc35c03ea30 2026-02-21T01:35:12.466 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.464+0000 7fc3817fa640 1 -- 10.20.193.43:0/2162852879 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fc38c054e20 con 0x7fc35c03ea30 2026-02-21T01:35:12.466 INFO:teuthology.orchestra.run.trial043.stderr:instructed osd(s) 5 to deep-scrub 2026-02-21T01:35:12.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 10 librados: watch_flush enter 2026-02-21T01:35:12.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 10 librados: watch_flush exit 2026-02-21T01:35:12.467 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 20 client.104225.objecter shutdown clearing up homeless session... 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 10 client.104225.objecter successfully canceled tick 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 >> v1:10.20.193.46:6812/860801619 conn(0x7fc35c03ea30 legacy=0x7fc35c05eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 10 monclient: shutdown 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 >> v1:10.20.193.43:6790/0 conn(0x7fc38c17fdc0 legacy=0x7fc38c16f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 shutdown_connections 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 >> 10.20.193.43:0/2162852879 conn(0x7fc38c08f620 msgr2=0x7fc38c13bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 shutdown_connections 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 1 -- 10.20.193.43:0/2162852879 wait complete. 2026-02-21T01:35:12.468 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.465+0000 7fc391a28640 1 librados: shutdown 2026-02-21T01:35:12.474 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:35:12.550 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient: get_monmap_and_config 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient: monmap: 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:12.541449+0000 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:12.541449+0000 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.551 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 1 Processor -- start 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 1 -- start start 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient: init 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient(hunting): picked mon.noname-a con 0x7f411408ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient(hunting): picked mon.noname-b con 0x7f411408d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.552 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient(hunting): picked mon.noname-c con 0x7f411408d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411408a690 con 0x7f411408ddb0 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411408b910 con 0x7f411408d8d0 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4114088ae0 con 0x7f411408d4d0 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4119d1a640 10 monclient(hunting): authenticate will time out at 1044.246810s 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f41137fe640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f411408ddb0 0x7f411408e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51144/0 (socket says 10.20.193.43:51144) 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f4112ffd640 1 --1- >> v1:10.20.193.43:6790/0 conn(0x7f411408d4d0 0x7f411417e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:50482/0 (socket says 10.20.193.43:50482) 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.540+0000 7f41137fe640 1 -- 10.20.193.43:0/3889447005 learned_addr learned my addr 10.20.193.43:0/3889447005 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345796040 0 0) 0x7f4114088ae0 con 0x7f411408d4d0 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.553 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): my global_id is 104228 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40f8003610 con 0x7f411408d4d0 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539885882 0 0) 0x7f411408a690 con 0x7f411408ddb0 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient(hunting): my global_id is 25263 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4114088ae0 con 0x7f411408ddb0 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2199734053 0 0) 0x7f4114088ae0 con 0x7f411408ddb0 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 >> v1:10.20.193.43:6790/0 conn(0x7f411408d4d0 legacy=0x7f411417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.554 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 >> v1:10.20.193.46:6789/0 conn(0x7f411408d8d0 legacy=0x7f411419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 monclient: found mon.noname-a 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41141a3ef0 con 0x7f411408ddb0 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4100002d70 con 0x7f411408ddb0 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 5 monclient: authenticate success, global_id 25263 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.555 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: dump: 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.556 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 <== mon.0 v1:10.20.193.43:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4100002fb0 con 0x7f411408ddb0 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 1 -- 10.20.193.43:0/3889447005 <== mon.0 v1:10.20.193.43:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f41000033f0 con 0x7f411408ddb0 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 4 set_mon_vals no callback set 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f41127fc640 10 monclient: dump: 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.557 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 10 monclient: shutdown 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 1 -- 10.20.193.43:0/3889447005 >> v1:10.20.193.43:6789/0 conn(0x7f411408ddb0 legacy=0x7f411408e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 1 -- 10.20.193.43:0/3889447005 shutdown_connections 2026-02-21T01:35:12.558 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 1 -- 10.20.193.43:0/3889447005 >> 10.20.193.43:0/3889447005 conn(0x7f411408f480 msgr2=0x7f411408f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 1 -- 10.20.193.43:0/3889447005 shutdown_connections 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 1 -- 10.20.193.43:0/3889447005 wait complete. 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 10 monclient: build_initial_monmap 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.541+0000 7f4119d1a640 10 monclient: monmap: 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:12.559 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 librados: starting msgr at 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 librados: starting objecter 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 Processor -- start 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 -- start start 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 librados: setting wanted keys 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 librados: calling monclient init 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient: init 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-21T01:35:12.560 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient(hunting): picked mon.noname-b con 0x7f411408d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient(hunting): picked mon.noname-a con 0x7f411408d8d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient(hunting): picked mon.noname-c con 0x7f411408ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41140570c0 con 0x7f411408d8d0 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4114108480 con 0x7f411408d4d0 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4114109f40 con 0x7f411408ddb0 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient(hunting): authenticate will time out at 1044.248378s 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4112ffd640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7f411408d8d0 0x7f411418b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:51150/0 (socket says 10.20.193.43:51150) 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4112ffd640 1 -- 10.20.193.43:0/754004540 learned_addr learned my addr 10.20.193.43:0/754004540 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 client.?.objecter ms_handle_connect 0x7f411408d8d0 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.561 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 client.?.objecter ms_handle_connect 0x7f411408ddb0 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069311968 0 0) 0x7f41140570c0 con 0x7f411408d8d0 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): my global_id is 25266 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40e4003610 con 0x7f411408d8d0 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523973399 0 0) 0x7f4114109f40 con 0x7f411408ddb0 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.562 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): my global_id is 104231 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41140570c0 con 0x7f411408ddb0 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 client.?.objecter ms_handle_connect 0x7f411408d4d0 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4287780285 0 0) 0x7f40e4003610 con 0x7f411408d8d0 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4114109f40 con 0x7f411408d8d0 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f41040031c0 con 0x7f411408d8d0 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): dump: 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.563 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282583160 0 0) 0x7f4114108480 con 0x7f411408d4d0 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _negotiate 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:12.564 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): my global_id is 84427 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40e4003610 con 0x7f411408d4d0 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3811090499 0 0) 0x7f41140570c0 con 0x7f411408ddb0 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4114108480 con 0x7f411408ddb0 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4108003390 con 0x7f411408ddb0 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient(hunting): dump: 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.565 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4080678390 0 0) 0x7f4114109f40 con 0x7f411408d8d0 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 >> v1:10.20.193.43:6790/0 conn(0x7f411408ddb0 legacy=0x7f411418cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 >> v1:10.20.193.46:6789/0 conn(0x7f411408d4d0 legacy=0x7f411411de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: _finish_hunting 0 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 monclient: found mon.a 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:12.566 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411410a7e0 con 0x7f411408d8d0 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: _finish_auth 0 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: _check_auth_tickets 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 5 monclient: authenticate success, global_id 25266 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient: _renew_subs 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4114108fe0 con 0x7f411408d8d0 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4104004b80 con 0x7f411408d8d0 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7f4104004ed0 con 0x7f411408d8d0 2026-02-21T01:35:12.567 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4111ffb640 4 set_mon_vals no callback set 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 client.25266.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f40effff640 10 monclient: dump: 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:12.568 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient: _renew_subs 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f411411e720 con 0x7f411408d8d0 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.542+0000 7f4119d1a640 1 librados: init done 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f4119d1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f4119d1a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f4119d1a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411408edb0 con 0x7f411408d8d0 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7f4104011850 con 0x7f411408d8d0 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7f410404d070 con 0x7f411408d8d0 2026-02-21T01:35:12.569 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f40effff640 10 client.25266.objecter ms_dispatch2 0x7f4114000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f40effff640 3 client.25266.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f40effff640 3 client.25266.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f40effff640 20 client.25266.objecter dump_active .. 0 homeless 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f41137fe640 10 monclient: get_auth_request con 0x7f40e403eb50 auth_method 0 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.543+0000 7f40effff640 10 client.25266.objecter ms_handle_connect 0x7f40e403eb50 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.545+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f41040177e0 con 0x7f411408d8d0 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.545+0000 7f40effff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:12.570 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.545+0000 7f40effff640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:12.651 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.650+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f411410a160 con 0x7f40e403eb50 2026-02-21T01:35:12.653 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f40effff640 1 -- 10.20.193.43:0/754004540 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114080 (unknown 2965378022 0 2636504351) 0x7f411410a160 con 0x7f40e403eb50 2026-02-21T01:35:12.654 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:35:12.655 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:35:12.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 10 librados: watch_flush enter 2026-02-21T01:35:12.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 10 librados: watch_flush exit 2026-02-21T01:35:12.656 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 20 client.25266.objecter shutdown clearing up homeless session... 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 10 client.25266.objecter successfully canceled tick 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 >> v1:10.20.193.46:6812/860801619 conn(0x7f40e403eb50 legacy=0x7f40e405f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 10 monclient: shutdown 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 >> v1:10.20.193.43:6789/0 conn(0x7f411408d8d0 legacy=0x7f411418b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 shutdown_connections 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 >> 10.20.193.43:0/754004540 conn(0x7f411408f480 msgr2=0x7f411411f350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 shutdown_connections 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 1 -- 10.20.193.43:0/754004540 wait complete. 2026-02-21T01:35:12.657 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:12.652+0000 7f4119d1a640 1 librados: shutdown 2026-02-21T01:35:12.662 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2026-02-21T01:35:10.666276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":391824,"kb_used_data":31536,"kb_used_omap":23534,"kb_used_meta":336657,"kb_avail":565839216,"statfs":{"total":579820584960,"available":579419357184,"internally_reserved":0,"allocated":32292864,"data_stored":15397220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24099003,"internal_metadata":344737605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001190"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429993+0000","last_change":"2026-02-21T01:28:23.945241+0000","last_active":"2026-02-21T01:34:04.429993+0000","last_peered":"2026-02-21T01:34:04.429993+0000","last_clean":"2026-02-21T01:34:04.429993+0000","last_became_active":"2026-02-21T01:28:23.922684+0000","last_became_peered":"2026-02-21T01:28:23.922684+0000","last_unstale":"2026-02-21T01:34:04.429993+0000","last_undegraded":"2026-02-21T01:34:04.429993+0000","last_fullsized":"2026-02-21T01:34:04.429993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.725896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510194+0000","last_change":"2026-02-21T01:28:23.903534+0000","last_active":"2026-02-21T01:34:05.510194+0000","last_peered":"2026-02-21T01:34:05.510194+0000","last_clean":"2026-02-21T01:34:05.510194+0000","last_became_active":"2026-02-21T01:28:23.901014+0000","last_became_peered":"2026-02-21T01:28:23.901014+0000","last_unstale":"2026-02-21T01:34:05.510194+0000","last_undegraded":"2026-02-21T01:34:05.510194+0000","last_fullsized":"2026-02-21T01:34:05.510194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:24:28.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510216+0000","last_change":"2026-02-21T01:28:23.915336+0000","last_active":"2026-02-21T01:34:05.510216+0000","last_peered":"2026-02-21T01:34:05.510216+0000","last_clean":"2026-02-21T01:34:05.510216+0000","last_became_active":"2026-02-21T01:28:23.899839+0000","last_became_peered":"2026-02-21T01:28:23.899839+0000","last_unstale":"2026-02-21T01:34:05.510216+0000","last_undegraded":"2026-02-21T01:34:05.510216+0000","last_fullsized":"2026-02-21T01:34:05.510216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:21.620145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429956+0000","last_change":"2026-02-21T01:28:23.941012+0000","last_active":"2026-02-21T01:34:04.429956+0000","last_peered":"2026-02-21T01:34:04.429956+0000","last_clean":"2026-02-21T01:34:04.429956+0000","last_became_active":"2026-02-21T01:28:23.922704+0000","last_became_peered":"2026-02-21T01:28:23.922704+0000","last_unstale":"2026-02-21T01:34:04.429956+0000","last_undegraded":"2026-02-21T01:34:04.429956+0000","last_fullsized":"2026-02-21T01:34:04.429956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:59:39.930589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431997+0000","last_change":"2026-02-21T01:28:23.891399+0000","last_active":"2026-02-21T01:34:04.431997+0000","last_peered":"2026-02-21T01:34:04.431997+0000","last_clean":"2026-02-21T01:34:04.431997+0000","last_became_active":"2026-02-21T01:28:23.888345+0000","last_became_peered":"2026-02-21T01:28:23.888345+0000","last_unstale":"2026-02-21T01:34:04.431997+0000","last_undegraded":"2026-02-21T01:34:04.431997+0000","last_fullsized":"2026-02-21T01:34:04.431997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:03:38.993396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":602,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510784+0000","last_change":"2026-02-21T01:28:23.902177+0000","last_active":"2026-02-21T01:34:05.510784+0000","last_peered":"2026-02-21T01:34:05.510784+0000","last_clean":"2026-02-21T01:34:05.510784+0000","last_became_active":"2026-02-21T01:28:23.900280+0000","last_became_peered":"2026-02-21T01:28:23.900280+0000","last_unstale":"2026-02-21T01:34:05.510784+0000","last_undegraded":"2026-02-21T01:34:05.510784+0000","last_fullsized":"2026-02-21T01:34:05.510784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:30:10.284746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510674+0000","last_change":"2026-02-21T01:28:23.922714+0000","last_active":"2026-02-21T01:34:05.510674+0000","last_peered":"2026-02-21T01:34:05.510674+0000","last_clean":"2026-02-21T01:34:05.510674+0000","last_became_active":"2026-02-21T01:28:23.915403+0000","last_became_peered":"2026-02-21T01:28:23.915403+0000","last_unstale":"2026-02-21T01:34:05.510674+0000","last_undegraded":"2026-02-21T01:34:05.510674+0000","last_fullsized":"2026-02-21T01:34:05.510674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:16:45.257976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510399+0000","last_change":"2026-02-21T01:28:23.913408+0000","last_active":"2026-02-21T01:34:05.510399+0000","last_peered":"2026-02-21T01:34:05.510399+0000","last_clean":"2026-02-21T01:34:05.510399+0000","last_became_active":"2026-02-21T01:28:23.912821+0000","last_became_peered":"2026-02-21T01:28:23.912821+0000","last_unstale":"2026-02-21T01:34:05.510399+0000","last_undegraded":"2026-02-21T01:34:05.510399+0000","last_fullsized":"2026-02-21T01:34:05.510399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:13:33.758245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.429984+0000","last_change":"2026-02-21T01:28:23.959484+0000","last_active":"2026-02-21T01:34:04.429984+0000","last_peered":"2026-02-21T01:34:04.429984+0000","last_clean":"2026-02-21T01:34:04.429984+0000","last_became_active":"2026-02-21T01:28:23.953780+0000","last_became_peered":"2026-02-21T01:28:23.953780+0000","last_unstale":"2026-02-21T01:34:04.429984+0000","last_undegraded":"2026-02-21T01:34:04.429984+0000","last_fullsized":"2026-02-21T01:34:04.429984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:09:52.644681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431341+0000","last_change":"2026-02-21T01:28:23.922395+0000","last_active":"2026-02-21T01:34:04.431341+0000","last_peered":"2026-02-21T01:34:04.431341+0000","last_clean":"2026-02-21T01:34:04.431341+0000","last_became_active":"2026-02-21T01:28:23.921588+0000","last_became_peered":"2026-02-21T01:28:23.921588+0000","last_unstale":"2026-02-21T01:34:04.431341+0000","last_undegraded":"2026-02-21T01:34:04.431341+0000","last_fullsized":"2026-02-21T01:34:04.431341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:18:14.248475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510230+0000","last_change":"2026-02-21T01:28:23.919446+0000","last_active":"2026-02-21T01:34:05.510230+0000","last_peered":"2026-02-21T01:34:05.510230+0000","last_clean":"2026-02-21T01:34:05.510230+0000","last_became_active":"2026-02-21T01:28:23.915407+0000","last_became_peered":"2026-02-21T01:28:23.915407+0000","last_unstale":"2026-02-21T01:34:05.510230+0000","last_undegraded":"2026-02-21T01:34:05.510230+0000","last_fullsized":"2026-02-21T01:34:05.510230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T08:19:21.219982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510438+0000","last_change":"2026-02-21T01:28:23.922558+0000","last_active":"2026-02-21T01:34:05.510438+0000","last_peered":"2026-02-21T01:34:05.510438+0000","last_clean":"2026-02-21T01:34:05.510438+0000","last_became_active":"2026-02-21T01:28:23.913824+0000","last_became_peered":"2026-02-21T01:28:23.913824+0000","last_unstale":"2026-02-21T01:34:05.510438+0000","last_undegraded":"2026-02-21T01:34:05.510438+0000","last_fullsized":"2026-02-21T01:34:05.510438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:11.834211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511918+0000","last_change":"2026-02-21T01:28:23.941204+0000","last_active":"2026-02-21T01:34:05.511918+0000","last_peered":"2026-02-21T01:34:05.511918+0000","last_clean":"2026-02-21T01:34:05.511918+0000","last_became_active":"2026-02-21T01:28:23.938182+0000","last_became_peered":"2026-02-21T01:28:23.938182+0000","last_unstale":"2026-02-21T01:34:05.511918+0000","last_undegraded":"2026-02-21T01:34:05.511918+0000","last_fullsized":"2026-02-21T01:34:05.511918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:58:59.794230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510620+0000","last_change":"2026-02-21T01:27:56.910464+0000","last_active":"2026-02-21T01:34:05.510620+0000","last_peered":"2026-02-21T01:34:05.510620+0000","last_clean":"2026-02-21T01:34:05.510620+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:34:05.510620+0000","last_undegraded":"2026-02-21T01:34:05.510620+0000","last_fullsized":"2026-02-21T01:34:05.510620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:23:00.125725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430078+0000","last_change":"2026-02-21T01:28:23.930558+0000","last_active":"2026-02-21T01:34:04.430078+0000","last_peered":"2026-02-21T01:34:04.430078+0000","last_clean":"2026-02-21T01:34:04.430078+0000","last_became_active":"2026-02-21T01:28:23.915990+0000","last_became_peered":"2026-02-21T01:28:23.915990+0000","last_unstale":"2026-02-21T01:34:04.430078+0000","last_undegraded":"2026-02-21T01:34:04.430078+0000","last_fullsized":"2026-02-21T01:34:04.430078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:07:49.065119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510797+0000","last_change":"2026-02-21T01:27:56.809979+0000","last_active":"2026-02-21T01:34:05.510797+0000","last_peered":"2026-02-21T01:34:05.510797+0000","last_clean":"2026-02-21T01:34:05.510797+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:34:05.510797+0000","last_undegraded":"2026-02-21T01:34:05.510797+0000","last_fullsized":"2026-02-21T01:34:05.510797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:10:34.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":597,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432400+0000","last_change":"2026-02-21T01:28:23.871764+0000","last_active":"2026-02-21T01:34:04.432400+0000","last_peered":"2026-02-21T01:34:04.432400+0000","last_clean":"2026-02-21T01:34:04.432400+0000","last_became_active":"2026-02-21T01:28:23.869997+0000","last_became_peered":"2026-02-21T01:28:23.869997+0000","last_unstale":"2026-02-21T01:34:04.432400+0000","last_undegraded":"2026-02-21T01:34:04.432400+0000","last_fullsized":"2026-02-21T01:34:04.432400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:28:18.194059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510519+0000","last_change":"2026-02-21T01:27:56.910390+0000","last_active":"2026-02-21T01:34:05.510519+0000","last_peered":"2026-02-21T01:34:05.510519+0000","last_clean":"2026-02-21T01:34:05.510519+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:34:05.510519+0000","last_undegraded":"2026-02-21T01:34:05.510519+0000","last_fullsized":"2026-02-21T01:34:05.510519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:30:35.372116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"22'11","reported_seq":622,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510740+0000","last_change":"2026-02-21T01:28:23.890310+0000","last_active":"2026-02-21T01:34:05.510740+0000","last_peered":"2026-02-21T01:34:05.510740+0000","last_clean":"2026-02-21T01:34:05.510740+0000","last_became_active":"2026-02-21T01:28:23.889305+0000","last_became_peered":"2026-02-21T01:28:23.889305+0000","last_unstale":"2026-02-21T01:34:05.510740+0000","last_undegraded":"2026-02-21T01:34:05.510740+0000","last_fullsized":"2026-02-21T01:34:05.510740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:57:40.956411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":617,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510721+0000","last_change":"2026-02-21T01:27:56.810259+0000","last_active":"2026-02-21T01:34:05.510721+0000","last_peered":"2026-02-21T01:34:05.510721+0000","last_clean":"2026-02-21T01:34:05.510721+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:34:05.510721+0000","last_undegraded":"2026-02-21T01:34:05.510721+0000","last_fullsized":"2026-02-21T01:34:05.510721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:46:43.275173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":608,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510617+0000","last_change":"2026-02-21T01:28:23.930311+0000","last_active":"2026-02-21T01:34:05.510617+0000","last_peered":"2026-02-21T01:34:05.510617+0000","last_clean":"2026-02-21T01:34:05.510617+0000","last_became_active":"2026-02-21T01:28:23.924669+0000","last_became_peered":"2026-02-21T01:28:23.924669+0000","last_unstale":"2026-02-21T01:34:05.510617+0000","last_undegraded":"2026-02-21T01:34:05.510617+0000","last_fullsized":"2026-02-21T01:34:05.510617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:46:07.181375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":614,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431472+0000","last_change":"2026-02-21T01:27:56.812438+0000","last_active":"2026-02-21T01:34:04.431472+0000","last_peered":"2026-02-21T01:34:04.431472+0000","last_clean":"2026-02-21T01:34:04.431472+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:34:04.431472+0000","last_undegraded":"2026-02-21T01:34:04.431472+0000","last_fullsized":"2026-02-21T01:34:04.431472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:36.462722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430071+0000","last_change":"2026-02-21T01:28:23.933934+0000","last_active":"2026-02-21T01:34:04.430071+0000","last_peered":"2026-02-21T01:34:04.430071+0000","last_clean":"2026-02-21T01:34:04.430071+0000","last_became_active":"2026-02-21T01:28:23.926401+0000","last_became_peered":"2026-02-21T01:28:23.926401+0000","last_unstale":"2026-02-21T01:34:04.430071+0000","last_undegraded":"2026-02-21T01:34:04.430071+0000","last_fullsized":"2026-02-21T01:34:04.430071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:40:24.787719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512684+0000","last_change":"2026-02-21T01:27:56.809832+0000","last_active":"2026-02-21T01:34:05.512684+0000","last_peered":"2026-02-21T01:34:05.512684+0000","last_clean":"2026-02-21T01:34:05.512684+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:34:05.512684+0000","last_undegraded":"2026-02-21T01:34:05.512684+0000","last_fullsized":"2026-02-21T01:34:05.512684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:07:51.070520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512312+0000","last_change":"2026-02-21T01:28:23.920345+0000","last_active":"2026-02-21T01:34:05.512312+0000","last_peered":"2026-02-21T01:34:05.512312+0000","last_clean":"2026-02-21T01:34:05.512312+0000","last_became_active":"2026-02-21T01:28:23.914843+0000","last_became_peered":"2026-02-21T01:28:23.914843+0000","last_unstale":"2026-02-21T01:34:05.512312+0000","last_undegraded":"2026-02-21T01:34:05.512312+0000","last_fullsized":"2026-02-21T01:34:05.512312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:01:52.859059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510234+0000","last_change":"2026-02-21T01:27:56.910246+0000","last_active":"2026-02-21T01:34:05.510234+0000","last_peered":"2026-02-21T01:34:05.510234+0000","last_clean":"2026-02-21T01:34:05.510234+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:34:05.510234+0000","last_undegraded":"2026-02-21T01:34:05.510234+0000","last_fullsized":"2026-02-21T01:34:05.510234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:04:16.530610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430076+0000","last_change":"2026-02-21T01:28:23.920796+0000","last_active":"2026-02-21T01:34:04.430076+0000","last_peered":"2026-02-21T01:34:04.430076+0000","last_clean":"2026-02-21T01:34:04.430076+0000","last_became_active":"2026-02-21T01:28:23.915656+0000","last_became_peered":"2026-02-21T01:28:23.915656+0000","last_unstale":"2026-02-21T01:34:04.430076+0000","last_undegraded":"2026-02-21T01:34:04.430076+0000","last_fullsized":"2026-02-21T01:34:04.430076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:51:20.257392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":613,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.432963+0000","last_change":"2026-02-21T01:27:56.811979+0000","last_active":"2026-02-21T01:34:04.432963+0000","last_peered":"2026-02-21T01:34:04.432963+0000","last_clean":"2026-02-21T01:34:04.432963+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:34:04.432963+0000","last_undegraded":"2026-02-21T01:34:04.432963+0000","last_fullsized":"2026-02-21T01:34:04.432963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:53.796817+0000","last_clean_scrub_stamp":"2026-02-21T01:27:53.796817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:40:32.672935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'112","reported_seq":760,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510225+0000","last_change":"2026-02-21T01:27:52.453379+0000","last_active":"2026-02-21T01:34:05.510225+0000","last_peered":"2026-02-21T01:34:05.510225+0000","last_clean":"2026-02-21T01:34:05.510225+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:34:05.510225+0000","last_undegraded":"2026-02-21T01:34:05.510225+0000","last_fullsized":"2026-02-21T01:34:05.510225+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:27:50.762860+0000","last_clean_scrub_stamp":"2026-02-21T01:27:50.762860+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:09:53.814896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":608,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510578+0000","last_change":"2026-02-21T01:28:23.888153+0000","last_active":"2026-02-21T01:34:05.510578+0000","last_peered":"2026-02-21T01:34:05.510578+0000","last_clean":"2026-02-21T01:34:05.510578+0000","last_became_active":"2026-02-21T01:28:23.886858+0000","last_became_peered":"2026-02-21T01:28:23.886858+0000","last_unstale":"2026-02-21T01:34:05.510578+0000","last_undegraded":"2026-02-21T01:34:05.510578+0000","last_fullsized":"2026-02-21T01:34:05.510578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:00:16.121993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512555+0000","last_change":"2026-02-21T01:28:23.902882+0000","last_active":"2026-02-21T01:34:05.512555+0000","last_peered":"2026-02-21T01:34:05.512555+0000","last_clean":"2026-02-21T01:34:05.512555+0000","last_became_active":"2026-02-21T01:28:23.897729+0000","last_became_peered":"2026-02-21T01:28:23.897729+0000","last_unstale":"2026-02-21T01:34:05.512555+0000","last_undegraded":"2026-02-21T01:34:05.512555+0000","last_fullsized":"2026-02-21T01:34:05.512555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:54:58.723961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512066+0000","last_change":"2026-02-21T01:28:23.915267+0000","last_active":"2026-02-21T01:34:05.512066+0000","last_peered":"2026-02-21T01:34:05.512066+0000","last_clean":"2026-02-21T01:34:05.512066+0000","last_became_active":"2026-02-21T01:28:23.914559+0000","last_became_peered":"2026-02-21T01:28:23.914559+0000","last_unstale":"2026-02-21T01:34:05.512066+0000","last_undegraded":"2026-02-21T01:34:05.512066+0000","last_fullsized":"2026-02-21T01:34:05.512066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:50:14.365478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430111+0000","last_change":"2026-02-21T01:28:23.915431+0000","last_active":"2026-02-21T01:34:04.430111+0000","last_peered":"2026-02-21T01:34:04.430111+0000","last_clean":"2026-02-21T01:34:04.430111+0000","last_became_active":"2026-02-21T01:28:23.912391+0000","last_became_peered":"2026-02-21T01:28:23.912391+0000","last_unstale":"2026-02-21T01:34:04.430111+0000","last_undegraded":"2026-02-21T01:34:04.430111+0000","last_fullsized":"2026-02-21T01:34:04.430111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:02:54.959438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511153+0000","last_change":"2026-02-21T01:28:23.934029+0000","last_active":"2026-02-21T01:34:05.511153+0000","last_peered":"2026-02-21T01:34:05.511153+0000","last_clean":"2026-02-21T01:34:05.511153+0000","last_became_active":"2026-02-21T01:28:23.930449+0000","last_became_peered":"2026-02-21T01:28:23.930449+0000","last_unstale":"2026-02-21T01:34:05.511153+0000","last_undegraded":"2026-02-21T01:34:05.511153+0000","last_fullsized":"2026-02-21T01:34:05.511153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:48:42.258342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":599,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.430005+0000","last_change":"2026-02-21T01:28:23.931187+0000","last_active":"2026-02-21T01:34:04.430005+0000","last_peered":"2026-02-21T01:34:04.430005+0000","last_clean":"2026-02-21T01:34:04.430005+0000","last_became_active":"2026-02-21T01:28:23.921627+0000","last_became_peered":"2026-02-21T01:28:23.921627+0000","last_unstale":"2026-02-21T01:34:04.430005+0000","last_undegraded":"2026-02-21T01:34:04.430005+0000","last_fullsized":"2026-02-21T01:34:04.430005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:50:18.522770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":598,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.511401+0000","last_change":"2026-02-21T01:28:23.945564+0000","last_active":"2026-02-21T01:34:05.511401+0000","last_peered":"2026-02-21T01:34:05.511401+0000","last_clean":"2026-02-21T01:34:05.511401+0000","last_became_active":"2026-02-21T01:28:23.945129+0000","last_became_peered":"2026-02-21T01:28:23.945129+0000","last_unstale":"2026-02-21T01:34:05.511401+0000","last_undegraded":"2026-02-21T01:34:05.511401+0000","last_fullsized":"2026-02-21T01:34:05.511401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:41:28.842721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":602,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510682+0000","last_change":"2026-02-21T01:28:23.881341+0000","last_active":"2026-02-21T01:34:05.510682+0000","last_peered":"2026-02-21T01:34:05.510682+0000","last_clean":"2026-02-21T01:34:05.510682+0000","last_became_active":"2026-02-21T01:28:23.880056+0000","last_became_peered":"2026-02-21T01:28:23.880056+0000","last_unstale":"2026-02-21T01:34:05.510682+0000","last_undegraded":"2026-02-21T01:34:05.510682+0000","last_fullsized":"2026-02-21T01:34:05.510682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:56:36.344912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":601,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510530+0000","last_change":"2026-02-21T01:28:23.925048+0000","last_active":"2026-02-21T01:34:05.510530+0000","last_peered":"2026-02-21T01:34:05.510530+0000","last_clean":"2026-02-21T01:34:05.510530+0000","last_became_active":"2026-02-21T01:28:23.916467+0000","last_became_peered":"2026-02-21T01:28:23.916467+0000","last_unstale":"2026-02-21T01:34:05.510530+0000","last_undegraded":"2026-02-21T01:34:05.510530+0000","last_fullsized":"2026-02-21T01:34:05.510530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:37:59.497146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.510414+0000","last_change":"2026-02-21T01:28:23.918503+0000","last_active":"2026-02-21T01:34:05.510414+0000","last_peered":"2026-02-21T01:34:05.510414+0000","last_clean":"2026-02-21T01:34:05.510414+0000","last_became_active":"2026-02-21T01:28:23.916777+0000","last_became_peered":"2026-02-21T01:28:23.916777+0000","last_unstale":"2026-02-21T01:34:05.510414+0000","last_undegraded":"2026-02-21T01:34:05.510414+0000","last_fullsized":"2026-02-21T01:34:05.510414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:50:28.275253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":595,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:05.512361+0000","last_change":"2026-02-21T01:28:23.895892+0000","last_active":"2026-02-21T01:34:05.512361+0000","last_peered":"2026-02-21T01:34:05.512361+0000","last_clean":"2026-02-21T01:34:05.512361+0000","last_became_active":"2026-02-21T01:28:23.895201+0000","last_became_peered":"2026-02-21T01:28:23.895201+0000","last_unstale":"2026-02-21T01:34:05.512361+0000","last_undegraded":"2026-02-21T01:34:05.512361+0000","last_fullsized":"2026-02-21T01:34:05.512361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:21:32.687664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":596,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:34:04.431794+0000","last_change":"2026-02-21T01:28:23.890053+0000","last_active":"2026-02-21T01:34:04.431794+0000","last_peered":"2026-02-21T01:34:04.431794+0000","last_clean":"2026-02-21T01:34:04.431794+0000","last_became_active":"2026-02-21T01:28:23.886126+0000","last_became_peered":"2026-02-21T01:28:23.886126+0000","last_unstale":"2026-02-21T01:34:04.431794+0000","last_undegraded":"2026-02-21T01:34:04.431794+0000","last_fullsized":"2026-02-21T01:34:04.431794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:28:22.829156+0000","last_clean_scrub_stamp":"2026-02-21T01:28:22.829156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:16:07.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":5814,"kb_used_meta":57225,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5954498,"internal_metadata":58598462},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640347,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":8625,"kb_used_meta":54414,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8832023,"internal_metadata":55720937},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640347,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68656,"kb_used_data":5600,"kb_used_omap":205,"kb_used_meta":62834,"kb_avail":94303184,"statfs":{"total":96636764160,"available":96566460416,"internally_reserved":0,"allocated":5734400,"data_stored":2918814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210051,"internal_metadata":64342909},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640346,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68136,"kb_used_data":5080,"kb_used_omap":5681,"kb_used_meta":57358,"kb_avail":94303704,"statfs":{"total":96636764160,"available":96566992896,"internally_reserved":0,"allocated":5201920,"data_stored":2389886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5818260,"internal_metadata":58734700},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640346,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50092,"kb_used_data":5084,"kb_used_omap":201,"kb_used_meta":44790,"kb_avail":94321748,"statfs":{"total":96636764160,"available":96585469952,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":206623,"internal_metadata":45865185},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68660,"kb_used_data":5604,"kb_used_omap":3005,"kb_used_meta":60034,"kb_avail":94303180,"statfs":{"total":96636764160,"available":96566456320,"internally_reserved":0,"allocated":5738496,"data_stored":2918819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3077548,"internal_metadata":61475412},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.729 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-21T01:27:53.796817+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=53, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-21T01:27:50.762860+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=27, tm_sec=50, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.730 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.731 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.731 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.731 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.731 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.731 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2026-02-21T01:28:22.829156+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=28, tm_sec=22, tm_wday=5, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=21, tm_hour=1, tm_min=35, tm_sec=9, tm_wday=5, tm_yday=52, tm_isdst=0) 2026-02-21T01:35:12.731 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-21T01:35:32.732 DEBUG:teuthology.orchestra.run.trial043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-21T01:35:32.810 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient: get_monmap_and_config 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient: build_initial_monmap 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient: monmap: 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:32.802458+0000 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:32.802458+0000 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.811 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 1 Processor -- start 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 1 -- start start 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient: init 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient(hunting): picked mon.noname-a con 0x7fe66808ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient(hunting): picked mon.noname-c con 0x7fe66808d4d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient(hunting): picked mon.noname-b con 0x7fe66808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:32.812 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66808a690 con 0x7fe66808ddb0 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66808b910 con 0x7fe66808d4d0 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe668088ae0 con 0x7fe66808d8d0 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe66cc8b640 10 monclient(hunting): authenticate will time out at 1064.507869s 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe666575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fe66808ddb0 0x7fe66808e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:45104/0 (socket says 10.20.193.43:45104) 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.801+0000 7fe666575640 1 -- 10.20.193.43:0/3763342118 learned_addr learned my addr 10.20.193.43:0/3763342118 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792093169 0 0) 0x7fe66808a690 con 0x7fe66808ddb0 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): _negotiate 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): my global_id is 25269 2026-02-21T01:35:32.813 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe654003610 con 0x7fe66808ddb0 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829627308 0 0) 0x7fe668088ae0 con 0x7fe66808d8d0 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): _negotiate 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient(hunting): my global_id is 104234 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe66808a690 con 0x7fe66808d8d0 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1328047117 0 0) 0x7fe66808a690 con 0x7fe66808d8d0 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 >> v1:10.20.193.46:6789/0 conn(0x7fe66808d4d0 legacy=0x7fe66817e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 >> v1:10.20.193.43:6789/0 conn(0x7fe66808ddb0 legacy=0x7fe66808e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: _finish_hunting 0 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 monclient: found mon.noname-b 2026-02-21T01:35:32.814 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6681a3ef0 con 0x7fe66808d8d0 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: _finish_auth 0 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: _check_auth_tickets 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe658003170 con 0x7fe66808d8d0 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: dump: 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.815 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 5 monclient: authenticate success, global_id 104234 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6580033c0 con 0x7fe66808d8d0 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:32.816 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 1 -- 10.20.193.43:0/3763342118 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe658003800 con 0x7fe66808d8d0 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe665573640 10 monclient: dump: 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:32.817 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 4 set_mon_vals no callback set 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 10 monclient: shutdown 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 1 -- 10.20.193.43:0/3763342118 >> v1:10.20.193.43:6790/0 conn(0x7fe66808d8d0 legacy=0x7fe66819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 1 -- 10.20.193.43:0/3763342118 shutdown_connections 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 1 -- 10.20.193.43:0/3763342118 >> 10.20.193.43:0/3763342118 conn(0x7fe66808f480 msgr2=0x7fe66808f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 1 -- 10.20.193.43:0/3763342118 shutdown_connections 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.802+0000 7fe66cc8b640 1 -- 10.20.193.43:0/3763342118 wait complete. 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: build_initial_monmap 2026-02-21T01:35:32.818 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: monmap: 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 librados: starting msgr at 2026-02-21T01:35:32.819 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 librados: starting objecter 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 Processor -- start 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 -- start start 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 librados: setting wanted keys 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 librados: calling monclient init 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: init 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient(hunting): picked mon.noname-a con 0x7fe66808d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient(hunting): picked mon.noname-c con 0x7fe66808d8d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient(hunting): picked mon.noname-b con 0x7fe66808ddb0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe668127260 con 0x7fe66808d4d0 2026-02-21T01:35:32.820 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66805e1b0 con 0x7fe66808ddb0 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe668124f00 con 0x7fe66808d8d0 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient(hunting): authenticate will time out at 1064.509493s 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe666575640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7fe66808d4d0 0x7fe66811dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:45106/0 (socket says 10.20.193.43:45106) 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe666575640 1 -- 10.20.193.43:0/622491549 learned_addr learned my addr 10.20.193.43:0/622491549 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 client.?.objecter ms_handle_connect 0x7fe66808d4d0 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 client.?.objecter ms_handle_connect 0x7fe66808d8d0 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2167777834 0 0) 0x7fe668127260 con 0x7fe66808d4d0 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:32.821 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): my global_id is 25272 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe634003610 con 0x7fe66808d4d0 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436247274 0 0) 0x7fe668124f00 con 0x7fe66808d8d0 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): _negotiate 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): my global_id is 104237 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe668127260 con 0x7fe66808d8d0 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1070493569 0 0) 0x7fe634003610 con 0x7fe66808d4d0 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe668124f00 con 0x7fe66808d4d0 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1631906001 0 0) 0x7fe668127260 con 0x7fe66808d8d0 2026-02-21T01:35:32.822 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe634003610 con 0x7fe66808d8d0 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe65c0030f0 con 0x7fe66808d4d0 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): dump: 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:32.823 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe650003090 con 0x7fe66808d8d0 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient(hunting): dump: 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.824 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 client.?.objecter ms_handle_connect 0x7fe66808ddb0 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 966302846 0 0) 0x7fe668124f00 con 0x7fe66808d4d0 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 >> v1:10.20.193.43:6790/0 conn(0x7fe66808d8d0 legacy=0x7fe66819a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 >> v1:10.20.193.46:6789/0 conn(0x7fe66808ddb0 legacy=0x7fe66819c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: _finish_hunting 0 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 monclient: found mon.a 2026-02-21T01:35:32.825 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6681269c0 con 0x7fe66808d4d0 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: _finish_auth 0 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: _check_auth_tickets 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 5 monclient: authenticate success, global_id 25272 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: _renew_subs 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6681107d0 con 0x7fe66808d4d0 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe65c0048d0 con 0x7fe66808d4d0 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:32.826 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 client.25272.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: _renew_subs 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7fe65c004c20 con 0x7fe66808d4d0 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe668124680 con 0x7fe66808d4d0 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe66cc8b640 1 librados: init done 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe664d72640 4 set_mon_vals no callback set 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.803+0000 7fe64effd640 10 monclient: dump: 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.827 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7fe65c0115a0 con 0x7fe66808d4d0 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe66cc8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe66cc8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe66cc8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66805c9a0 con 0x7fe66808d4d0 2026-02-21T01:35:32.828 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7fe65c04dfb0 con 0x7fe66808d4d0 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe64effd640 10 client.25272.objecter ms_dispatch2 0x7fe668000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe64effd640 3 client.25272.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe64effd640 3 client.25272.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe64effd640 20 client.25272.objecter dump_active .. 0 homeless 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.804+0000 7fe665d74640 10 monclient: get_auth_request con 0x7fe63403e8f0 auth_method 0 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.805+0000 7fe64effd640 10 client.25272.objecter ms_handle_connect 0x7fe63403e8f0 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.806+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe65c0176b0 con 0x7fe66808d4d0 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.806+0000 7fe64effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:32.829 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.806+0000 7fe64effd640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:32.914 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.912+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 --> v1:10.20.193.46:6812/860801619 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe668110bb0 con 0x7fe63403e8f0 2026-02-21T01:35:32.915 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.914+0000 7fe64effd640 1 -- 10.20.193.43:0/622491549 <== mgr.4107 v1:10.20.193.46:6812/860801619 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114106 (unknown 2965378022 0 1598586118) 0x7fe650007b60 con 0x7fe63403e8f0 2026-02-21T01:35:32.916 INFO:teuthology.orchestra.run.trial043.stdout: 2026-02-21T01:35:32.917 INFO:teuthology.orchestra.run.trial043.stderr:dumped all 2026-02-21T01:35:32.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 10 librados: watch_flush enter 2026-02-21T01:35:32.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 10 librados: watch_flush exit 2026-02-21T01:35:32.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 20 client.25272.objecter shutdown clearing up homeless session... 2026-02-21T01:35:32.918 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 10 client.25272.objecter successfully canceled tick 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 >> v1:10.20.193.46:6812/860801619 conn(0x7fe63403e8f0 legacy=0x7fe63405eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 10 monclient: shutdown 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 >> v1:10.20.193.43:6789/0 conn(0x7fe66808d4d0 legacy=0x7fe66811dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 shutdown_connections 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 >> 10.20.193.43:0/622491549 conn(0x7fe66808f480 msgr2=0x7fe66811f110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 shutdown_connections 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 1 -- 10.20.193.43:0/622491549 wait complete. 2026-02-21T01:35:32.919 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.915+0000 7fe66cc8b640 1 librados: shutdown 2026-02-21T01:35:32.924 INFO:teuthology.orchestra.run.trial043.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2026-02-21T01:35:32.668462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":391824,"kb_used_data":31536,"kb_used_omap":23534,"kb_used_meta":336657,"kb_avail":565839216,"statfs":{"total":579820584960,"available":579419357184,"internally_reserved":0,"allocated":32292864,"data_stored":15397220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24099003,"internal_metadata":344737605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001273"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":606,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:15.137004+0000","last_change":"2026-02-21T01:35:15.137004+0000","last_active":"2026-02-21T01:35:15.137004+0000","last_peered":"2026-02-21T01:35:15.137004+0000","last_clean":"2026-02-21T01:35:15.137004+0000","last_became_active":"2026-02-21T01:28:23.922684+0000","last_became_peered":"2026-02-21T01:28:23.922684+0000","last_unstale":"2026-02-21T01:35:15.137004+0000","last_undegraded":"2026-02-21T01:35:15.137004+0000","last_fullsized":"2026-02-21T01:35:15.137004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:15.136946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:15.136946+0000","last_clean_scrub_stamp":"2026-02-21T01:35:15.136946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:17:22.622693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":615,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:21.983181+0000","last_change":"2026-02-21T01:35:21.983181+0000","last_active":"2026-02-21T01:35:21.983181+0000","last_peered":"2026-02-21T01:35:21.983181+0000","last_clean":"2026-02-21T01:35:21.983181+0000","last_became_active":"2026-02-21T01:28:23.901014+0000","last_became_peered":"2026-02-21T01:28:23.901014+0000","last_unstale":"2026-02-21T01:35:21.983181+0000","last_undegraded":"2026-02-21T01:35:21.983181+0000","last_fullsized":"2026-02-21T01:35:21.983181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:21.983140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:21.983140+0000","last_clean_scrub_stamp":"2026-02-21T01:35:21.983140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:04:59.485828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":615,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:19.945338+0000","last_change":"2026-02-21T01:35:19.945338+0000","last_active":"2026-02-21T01:35:19.945338+0000","last_peered":"2026-02-21T01:35:19.945338+0000","last_clean":"2026-02-21T01:35:19.945338+0000","last_became_active":"2026-02-21T01:28:23.899839+0000","last_became_peered":"2026-02-21T01:28:23.899839+0000","last_unstale":"2026-02-21T01:35:19.945338+0000","last_undegraded":"2026-02-21T01:35:19.945338+0000","last_fullsized":"2026-02-21T01:35:19.945338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:19.945301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:19.945301+0000","last_clean_scrub_stamp":"2026-02-21T01:35:19.945301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:49:19.526775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":606,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:18.175273+0000","last_change":"2026-02-21T01:35:18.175273+0000","last_active":"2026-02-21T01:35:18.175273+0000","last_peered":"2026-02-21T01:35:18.175273+0000","last_clean":"2026-02-21T01:35:18.175273+0000","last_became_active":"2026-02-21T01:28:23.922704+0000","last_became_peered":"2026-02-21T01:28:23.922704+0000","last_unstale":"2026-02-21T01:35:18.175273+0000","last_undegraded":"2026-02-21T01:35:18.175273+0000","last_fullsized":"2026-02-21T01:35:18.175273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:18.175220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:18.175220+0000","last_clean_scrub_stamp":"2026-02-21T01:35:18.175220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:07:01.581339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":605,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:17.638589+0000","last_change":"2026-02-21T01:35:17.638589+0000","last_active":"2026-02-21T01:35:17.638589+0000","last_peered":"2026-02-21T01:35:17.638589+0000","last_clean":"2026-02-21T01:35:17.638589+0000","last_became_active":"2026-02-21T01:28:23.888345+0000","last_became_peered":"2026-02-21T01:28:23.888345+0000","last_unstale":"2026-02-21T01:35:17.638589+0000","last_undegraded":"2026-02-21T01:35:17.638589+0000","last_fullsized":"2026-02-21T01:35:17.638589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:17.638556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:17.638556+0000","last_clean_scrub_stamp":"2026-02-21T01:35:17.638556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:41:39.061582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":610,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:16.633947+0000","last_change":"2026-02-21T01:35:16.633947+0000","last_active":"2026-02-21T01:35:16.633947+0000","last_peered":"2026-02-21T01:35:16.633947+0000","last_clean":"2026-02-21T01:35:16.633947+0000","last_became_active":"2026-02-21T01:28:23.900280+0000","last_became_peered":"2026-02-21T01:28:23.900280+0000","last_unstale":"2026-02-21T01:35:16.633947+0000","last_undegraded":"2026-02-21T01:35:16.633947+0000","last_fullsized":"2026-02-21T01:35:16.633947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:16.633911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:16.633911+0000","last_clean_scrub_stamp":"2026-02-21T01:35:16.633911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:23:52.951223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":609,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:15.644035+0000","last_change":"2026-02-21T01:35:15.644035+0000","last_active":"2026-02-21T01:35:15.644035+0000","last_peered":"2026-02-21T01:35:15.644035+0000","last_clean":"2026-02-21T01:35:15.644035+0000","last_became_active":"2026-02-21T01:28:23.915403+0000","last_became_peered":"2026-02-21T01:28:23.915403+0000","last_unstale":"2026-02-21T01:35:15.644035+0000","last_undegraded":"2026-02-21T01:35:15.644035+0000","last_fullsized":"2026-02-21T01:35:15.644035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:15.644002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:15.644002+0000","last_clean_scrub_stamp":"2026-02-21T01:35:15.644002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:34:08.778860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":615,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:20.959849+0000","last_change":"2026-02-21T01:35:20.959849+0000","last_active":"2026-02-21T01:35:20.959849+0000","last_peered":"2026-02-21T01:35:20.959849+0000","last_clean":"2026-02-21T01:35:20.959849+0000","last_became_active":"2026-02-21T01:28:23.912821+0000","last_became_peered":"2026-02-21T01:28:23.912821+0000","last_unstale":"2026-02-21T01:35:20.959849+0000","last_undegraded":"2026-02-21T01:35:20.959849+0000","last_fullsized":"2026-02-21T01:35:20.959849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:20.959820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:20.959820+0000","last_clean_scrub_stamp":"2026-02-21T01:35:20.959820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:29:57.312574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:17.198142+0000","last_change":"2026-02-21T01:35:17.198117+0000","last_active":"2026-02-21T01:35:17.198142+0000","last_peered":"2026-02-21T01:35:17.198142+0000","last_clean":"2026-02-21T01:35:17.198142+0000","last_became_active":"2026-02-21T01:28:23.953780+0000","last_became_peered":"2026-02-21T01:28:23.953780+0000","last_unstale":"2026-02-21T01:35:17.198142+0000","last_undegraded":"2026-02-21T01:35:17.198142+0000","last_fullsized":"2026-02-21T01:35:17.198142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:17.198090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:17.198090+0000","last_clean_scrub_stamp":"2026-02-21T01:35:17.198090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:26:11.527832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":605,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:14.545592+0000","last_change":"2026-02-21T01:35:14.545569+0000","last_active":"2026-02-21T01:35:14.545592+0000","last_peered":"2026-02-21T01:35:14.545592+0000","last_clean":"2026-02-21T01:35:14.545592+0000","last_became_active":"2026-02-21T01:28:23.921588+0000","last_became_peered":"2026-02-21T01:28:23.921588+0000","last_unstale":"2026-02-21T01:35:14.545592+0000","last_undegraded":"2026-02-21T01:35:14.545592+0000","last_fullsized":"2026-02-21T01:35:14.545592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:14.545544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:14.545544+0000","last_clean_scrub_stamp":"2026-02-21T01:35:14.545544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:56:43.276276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":616,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:17.921417+0000","last_change":"2026-02-21T01:35:17.921383+0000","last_active":"2026-02-21T01:35:17.921417+0000","last_peered":"2026-02-21T01:35:17.921417+0000","last_clean":"2026-02-21T01:35:17.921417+0000","last_became_active":"2026-02-21T01:28:23.915407+0000","last_became_peered":"2026-02-21T01:28:23.915407+0000","last_unstale":"2026-02-21T01:35:17.921417+0000","last_undegraded":"2026-02-21T01:35:17.921417+0000","last_fullsized":"2026-02-21T01:35:17.921417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:17.921342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:17.921342+0000","last_clean_scrub_stamp":"2026-02-21T01:35:17.921342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:13:52.836161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":610,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:17.653776+0000","last_change":"2026-02-21T01:35:17.653732+0000","last_active":"2026-02-21T01:35:17.653776+0000","last_peered":"2026-02-21T01:35:17.653776+0000","last_clean":"2026-02-21T01:35:17.653776+0000","last_became_active":"2026-02-21T01:28:23.913824+0000","last_became_peered":"2026-02-21T01:28:23.913824+0000","last_unstale":"2026-02-21T01:35:17.653776+0000","last_undegraded":"2026-02-21T01:35:17.653776+0000","last_fullsized":"2026-02-21T01:35:17.653776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:17.653688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:17.653688+0000","last_clean_scrub_stamp":"2026-02-21T01:35:17.653688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:15:21.718386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":606,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:12.725529+0000","last_change":"2026-02-21T01:35:12.725529+0000","last_active":"2026-02-21T01:35:12.725529+0000","last_peered":"2026-02-21T01:35:12.725529+0000","last_clean":"2026-02-21T01:35:12.725529+0000","last_became_active":"2026-02-21T01:28:23.938182+0000","last_became_peered":"2026-02-21T01:28:23.938182+0000","last_unstale":"2026-02-21T01:35:12.725529+0000","last_undegraded":"2026-02-21T01:35:12.725529+0000","last_fullsized":"2026-02-21T01:35:12.725529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:12.725466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:12.725466+0000","last_clean_scrub_stamp":"2026-02-21T01:35:12.725466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:52:25.594284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":631,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:14.897261+0000","last_change":"2026-02-21T01:35:14.897261+0000","last_active":"2026-02-21T01:35:14.897261+0000","last_peered":"2026-02-21T01:35:14.897261+0000","last_clean":"2026-02-21T01:35:14.897261+0000","last_became_active":"2026-02-21T01:27:55.210332+0000","last_became_peered":"2026-02-21T01:27:55.210332+0000","last_unstale":"2026-02-21T01:35:14.897261+0000","last_undegraded":"2026-02-21T01:35:14.897261+0000","last_fullsized":"2026-02-21T01:35:14.897261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:14.897232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:14.897232+0000","last_clean_scrub_stamp":"2026-02-21T01:35:14.897232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T04:14:22.856411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056388399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:11.146273+0000","last_change":"2026-02-21T01:35:11.146273+0000","last_active":"2026-02-21T01:35:11.146273+0000","last_peered":"2026-02-21T01:35:11.146273+0000","last_clean":"2026-02-21T01:35:11.146273+0000","last_became_active":"2026-02-21T01:28:23.915990+0000","last_became_peered":"2026-02-21T01:28:23.915990+0000","last_unstale":"2026-02-21T01:35:11.146273+0000","last_undegraded":"2026-02-21T01:35:11.146273+0000","last_fullsized":"2026-02-21T01:35:11.146273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:11.146224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:11.146224+0000","last_clean_scrub_stamp":"2026-02-21T01:35:11.146224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:38:50.858608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:12.658850+0000","last_change":"2026-02-21T01:35:12.658850+0000","last_active":"2026-02-21T01:35:12.658850+0000","last_peered":"2026-02-21T01:35:12.658850+0000","last_clean":"2026-02-21T01:35:12.658850+0000","last_became_active":"2026-02-21T01:27:54.804765+0000","last_became_peered":"2026-02-21T01:27:54.804765+0000","last_unstale":"2026-02-21T01:35:12.658850+0000","last_undegraded":"2026-02-21T01:35:12.658850+0000","last_fullsized":"2026-02-21T01:35:12.658850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:12.658813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:12.658813+0000","last_clean_scrub_stamp":"2026-02-21T01:35:12.658813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T10:35:52.409668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000340952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":605,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:13.526344+0000","last_change":"2026-02-21T01:35:13.526344+0000","last_active":"2026-02-21T01:35:13.526344+0000","last_peered":"2026-02-21T01:35:13.526344+0000","last_clean":"2026-02-21T01:35:13.526344+0000","last_became_active":"2026-02-21T01:28:23.869997+0000","last_became_peered":"2026-02-21T01:28:23.869997+0000","last_unstale":"2026-02-21T01:35:13.526344+0000","last_undegraded":"2026-02-21T01:35:13.526344+0000","last_fullsized":"2026-02-21T01:35:13.526344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:13.526307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:13.526307+0000","last_clean_scrub_stamp":"2026-02-21T01:35:13.526307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:32:51.749983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":631,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:13.897763+0000","last_change":"2026-02-21T01:35:13.897763+0000","last_active":"2026-02-21T01:35:13.897763+0000","last_peered":"2026-02-21T01:35:13.897763+0000","last_clean":"2026-02-21T01:35:13.897763+0000","last_became_active":"2026-02-21T01:27:54.803719+0000","last_became_peered":"2026-02-21T01:27:54.803719+0000","last_unstale":"2026-02-21T01:35:13.897763+0000","last_undegraded":"2026-02-21T01:35:13.897763+0000","last_fullsized":"2026-02-21T01:35:13.897763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:13.897717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:13.897717+0000","last_clean_scrub_stamp":"2026-02-21T01:35:13.897717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:28:10.664899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052673599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"321'12","reported_seq":631,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:13.029533+0000","last_change":"2026-02-21T01:35:13.029533+0000","last_active":"2026-02-21T01:35:13.029533+0000","last_peered":"2026-02-21T01:35:13.029533+0000","last_clean":"2026-02-21T01:35:13.029533+0000","last_became_active":"2026-02-21T01:28:23.889305+0000","last_became_peered":"2026-02-21T01:28:23.889305+0000","last_unstale":"2026-02-21T01:35:13.029533+0000","last_undegraded":"2026-02-21T01:35:13.029533+0000","last_fullsized":"2026-02-21T01:35:13.029533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"321'12","last_scrub_stamp":"2026-02-21T01:35:13.029448+0000","last_deep_scrub":"321'12","last_deep_scrub_stamp":"2026-02-21T01:35:13.029448+0000","last_clean_scrub_stamp":"2026-02-21T01:35:13.029448+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:29:12.489527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:11.632646+0000","last_change":"2026-02-21T01:35:11.632646+0000","last_active":"2026-02-21T01:35:11.632646+0000","last_peered":"2026-02-21T01:35:11.632646+0000","last_clean":"2026-02-21T01:35:11.632646+0000","last_became_active":"2026-02-21T01:27:54.804609+0000","last_became_peered":"2026-02-21T01:27:54.804609+0000","last_unstale":"2026-02-21T01:35:11.632646+0000","last_undegraded":"2026-02-21T01:35:11.632646+0000","last_fullsized":"2026-02-21T01:35:11.632646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:11.632607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:11.632607+0000","last_clean_scrub_stamp":"2026-02-21T01:35:11.632607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:26:45.153005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00029145100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":616,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:15.934494+0000","last_change":"2026-02-21T01:35:15.934494+0000","last_active":"2026-02-21T01:35:15.934494+0000","last_peered":"2026-02-21T01:35:15.934494+0000","last_clean":"2026-02-21T01:35:15.934494+0000","last_became_active":"2026-02-21T01:28:23.924669+0000","last_became_peered":"2026-02-21T01:28:23.924669+0000","last_unstale":"2026-02-21T01:35:15.934494+0000","last_undegraded":"2026-02-21T01:35:15.934494+0000","last_fullsized":"2026-02-21T01:35:15.934494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:15.934449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:15.934449+0000","last_clean_scrub_stamp":"2026-02-21T01:35:15.934449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:06:35.070001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"321'3","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:12.503700+0000","last_change":"2026-02-21T01:35:12.503700+0000","last_active":"2026-02-21T01:35:12.503700+0000","last_peered":"2026-02-21T01:35:12.503700+0000","last_clean":"2026-02-21T01:35:12.503700+0000","last_became_active":"2026-02-21T01:27:54.805077+0000","last_became_peered":"2026-02-21T01:27:54.805077+0000","last_unstale":"2026-02-21T01:35:12.503700+0000","last_undegraded":"2026-02-21T01:35:12.503700+0000","last_fullsized":"2026-02-21T01:35:12.503700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"321'3","last_scrub_stamp":"2026-02-21T01:35:12.503671+0000","last_deep_scrub":"321'3","last_deep_scrub_stamp":"2026-02-21T01:35:12.503671+0000","last_clean_scrub_stamp":"2026-02-21T01:35:12.503671+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:32:48.509173+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00074078200000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:13.096676+0000","last_change":"2026-02-21T01:35:13.096676+0000","last_active":"2026-02-21T01:35:13.096676+0000","last_peered":"2026-02-21T01:35:13.096676+0000","last_clean":"2026-02-21T01:35:13.096676+0000","last_became_active":"2026-02-21T01:28:23.926401+0000","last_became_peered":"2026-02-21T01:28:23.926401+0000","last_unstale":"2026-02-21T01:35:13.096676+0000","last_undegraded":"2026-02-21T01:35:13.096676+0000","last_fullsized":"2026-02-21T01:35:13.096676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:13.096634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:13.096634+0000","last_clean_scrub_stamp":"2026-02-21T01:35:13.096634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T08:49:30.467158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":621,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:11.702972+0000","last_change":"2026-02-21T01:35:11.702972+0000","last_active":"2026-02-21T01:35:11.702972+0000","last_peered":"2026-02-21T01:35:11.702972+0000","last_clean":"2026-02-21T01:35:11.702972+0000","last_became_active":"2026-02-21T01:27:54.804916+0000","last_became_peered":"2026-02-21T01:27:54.804916+0000","last_unstale":"2026-02-21T01:35:11.702972+0000","last_undegraded":"2026-02-21T01:35:11.702972+0000","last_fullsized":"2026-02-21T01:35:11.702972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:11.702925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:11.702925+0000","last_clean_scrub_stamp":"2026-02-21T01:35:11.702925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T12:23:21.817388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00027714500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":604,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:14.058282+0000","last_change":"2026-02-21T01:35:14.058282+0000","last_active":"2026-02-21T01:35:14.058282+0000","last_peered":"2026-02-21T01:35:14.058282+0000","last_clean":"2026-02-21T01:35:14.058282+0000","last_became_active":"2026-02-21T01:28:23.914843+0000","last_became_peered":"2026-02-21T01:28:23.914843+0000","last_unstale":"2026-02-21T01:35:14.058282+0000","last_undegraded":"2026-02-21T01:35:14.058282+0000","last_fullsized":"2026-02-21T01:35:14.058282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:14.058230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:14.058230+0000","last_clean_scrub_stamp":"2026-02-21T01:35:14.058230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:55:58.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":631,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:12.905607+0000","last_change":"2026-02-21T01:35:12.905607+0000","last_active":"2026-02-21T01:35:12.905607+0000","last_peered":"2026-02-21T01:35:12.905607+0000","last_clean":"2026-02-21T01:35:12.905607+0000","last_became_active":"2026-02-21T01:27:54.804999+0000","last_became_peered":"2026-02-21T01:27:54.804999+0000","last_unstale":"2026-02-21T01:35:12.905607+0000","last_undegraded":"2026-02-21T01:35:12.905607+0000","last_fullsized":"2026-02-21T01:35:12.905607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:12.905575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:12.905575+0000","last_clean_scrub_stamp":"2026-02-21T01:35:12.905575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:05:41.642292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00038112600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:12.118788+0000","last_change":"2026-02-21T01:35:12.118788+0000","last_active":"2026-02-21T01:35:12.118788+0000","last_peered":"2026-02-21T01:35:12.118788+0000","last_clean":"2026-02-21T01:35:12.118788+0000","last_became_active":"2026-02-21T01:28:23.915656+0000","last_became_peered":"2026-02-21T01:28:23.915656+0000","last_unstale":"2026-02-21T01:35:12.118788+0000","last_undegraded":"2026-02-21T01:35:12.118788+0000","last_fullsized":"2026-02-21T01:35:12.118788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:12.118746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:12.118746+0000","last_clean_scrub_stamp":"2026-02-21T01:35:12.118746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:03:21.412260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"321'2","reported_seq":622,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:15.593845+0000","last_change":"2026-02-21T01:35:15.593845+0000","last_active":"2026-02-21T01:35:15.593845+0000","last_peered":"2026-02-21T01:35:15.593845+0000","last_clean":"2026-02-21T01:35:15.593845+0000","last_became_active":"2026-02-21T01:27:54.804273+0000","last_became_peered":"2026-02-21T01:27:54.804273+0000","last_unstale":"2026-02-21T01:35:15.593845+0000","last_undegraded":"2026-02-21T01:35:15.593845+0000","last_fullsized":"2026-02-21T01:35:15.593845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"321'2","last_scrub_stamp":"2026-02-21T01:35:15.593822+0000","last_deep_scrub":"321'2","last_deep_scrub_stamp":"2026-02-21T01:35:15.593822+0000","last_clean_scrub_stamp":"2026-02-21T01:35:15.593822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:32:06.667014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00026285600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"321'114","reported_seq":770,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:11.930697+0000","last_change":"2026-02-21T01:35:11.930697+0000","last_active":"2026-02-21T01:35:11.930697+0000","last_peered":"2026-02-21T01:35:11.930697+0000","last_clean":"2026-02-21T01:35:11.930697+0000","last_became_active":"2026-02-21T01:27:52.452943+0000","last_became_peered":"2026-02-21T01:27:52.452943+0000","last_unstale":"2026-02-21T01:35:11.930697+0000","last_undegraded":"2026-02-21T01:35:11.930697+0000","last_fullsized":"2026-02-21T01:35:11.930697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"321'114","last_scrub_stamp":"2026-02-21T01:35:11.930671+0000","last_deep_scrub":"321'114","last_deep_scrub_stamp":"2026-02-21T01:35:11.930671+0000","last_clean_scrub_stamp":"2026-02-21T01:35:11.930671+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T05:25:19.628485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":616,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:16.935514+0000","last_change":"2026-02-21T01:35:16.935514+0000","last_active":"2026-02-21T01:35:16.935514+0000","last_peered":"2026-02-21T01:35:16.935514+0000","last_clean":"2026-02-21T01:35:16.935514+0000","last_became_active":"2026-02-21T01:28:23.886858+0000","last_became_peered":"2026-02-21T01:28:23.886858+0000","last_unstale":"2026-02-21T01:35:16.935514+0000","last_undegraded":"2026-02-21T01:35:16.935514+0000","last_fullsized":"2026-02-21T01:35:16.935514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:16.935463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:16.935463+0000","last_clean_scrub_stamp":"2026-02-21T01:35:16.935463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:59:12.803180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":604,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:16.012168+0000","last_change":"2026-02-21T01:35:16.012168+0000","last_active":"2026-02-21T01:35:16.012168+0000","last_peered":"2026-02-21T01:35:16.012168+0000","last_clean":"2026-02-21T01:35:16.012168+0000","last_became_active":"2026-02-21T01:28:23.897729+0000","last_became_peered":"2026-02-21T01:28:23.897729+0000","last_unstale":"2026-02-21T01:35:16.012168+0000","last_undegraded":"2026-02-21T01:35:16.012168+0000","last_fullsized":"2026-02-21T01:35:16.012168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:16.012118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:16.012118+0000","last_clean_scrub_stamp":"2026-02-21T01:35:16.012118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:55:09.523148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":606,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:15.693309+0000","last_change":"2026-02-21T01:35:15.693309+0000","last_active":"2026-02-21T01:35:15.693309+0000","last_peered":"2026-02-21T01:35:15.693309+0000","last_clean":"2026-02-21T01:35:15.693309+0000","last_became_active":"2026-02-21T01:28:23.914559+0000","last_became_peered":"2026-02-21T01:28:23.914559+0000","last_unstale":"2026-02-21T01:35:15.693309+0000","last_undegraded":"2026-02-21T01:35:15.693309+0000","last_fullsized":"2026-02-21T01:35:15.693309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:15.693276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:15.693276+0000","last_clean_scrub_stamp":"2026-02-21T01:35:15.693276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T03:53:57.865179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:16.178001+0000","last_change":"2026-02-21T01:35:16.178001+0000","last_active":"2026-02-21T01:35:16.178001+0000","last_peered":"2026-02-21T01:35:16.178001+0000","last_clean":"2026-02-21T01:35:16.178001+0000","last_became_active":"2026-02-21T01:28:23.912391+0000","last_became_peered":"2026-02-21T01:28:23.912391+0000","last_unstale":"2026-02-21T01:35:16.178001+0000","last_undegraded":"2026-02-21T01:35:16.178001+0000","last_fullsized":"2026-02-21T01:35:16.178001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:16.177969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:16.177969+0000","last_clean_scrub_stamp":"2026-02-21T01:35:16.177969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:28:23.232996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":606,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:13.686522+0000","last_change":"2026-02-21T01:35:13.686522+0000","last_active":"2026-02-21T01:35:13.686522+0000","last_peered":"2026-02-21T01:35:13.686522+0000","last_clean":"2026-02-21T01:35:13.686522+0000","last_became_active":"2026-02-21T01:28:23.930449+0000","last_became_peered":"2026-02-21T01:28:23.930449+0000","last_unstale":"2026-02-21T01:35:13.686522+0000","last_undegraded":"2026-02-21T01:35:13.686522+0000","last_fullsized":"2026-02-21T01:35:13.686522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:13.686495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:13.686495+0000","last_clean_scrub_stamp":"2026-02-21T01:35:13.686495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:26:36.035779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":607,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:14.106026+0000","last_change":"2026-02-21T01:35:14.106026+0000","last_active":"2026-02-21T01:35:14.106026+0000","last_peered":"2026-02-21T01:35:14.106026+0000","last_clean":"2026-02-21T01:35:14.106026+0000","last_became_active":"2026-02-21T01:28:23.921627+0000","last_became_peered":"2026-02-21T01:28:23.921627+0000","last_unstale":"2026-02-21T01:35:14.106026+0000","last_undegraded":"2026-02-21T01:35:14.106026+0000","last_fullsized":"2026-02-21T01:35:14.106026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:14.105996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:14.105996+0000","last_clean_scrub_stamp":"2026-02-21T01:35:14.105996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:46:21.392427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":606,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:14.686730+0000","last_change":"2026-02-21T01:35:14.686730+0000","last_active":"2026-02-21T01:35:14.686730+0000","last_peered":"2026-02-21T01:35:14.686730+0000","last_clean":"2026-02-21T01:35:14.686730+0000","last_became_active":"2026-02-21T01:28:23.945129+0000","last_became_peered":"2026-02-21T01:28:23.945129+0000","last_unstale":"2026-02-21T01:35:14.686730+0000","last_undegraded":"2026-02-21T01:35:14.686730+0000","last_fullsized":"2026-02-21T01:35:14.686730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:14.686683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:14.686683+0000","last_clean_scrub_stamp":"2026-02-21T01:35:14.686683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T06:38:02.735783+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":610,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:13.690437+0000","last_change":"2026-02-21T01:35:13.690437+0000","last_active":"2026-02-21T01:35:13.690437+0000","last_peered":"2026-02-21T01:35:13.690437+0000","last_clean":"2026-02-21T01:35:13.690437+0000","last_became_active":"2026-02-21T01:28:23.880056+0000","last_became_peered":"2026-02-21T01:28:23.880056+0000","last_unstale":"2026-02-21T01:35:13.690437+0000","last_undegraded":"2026-02-21T01:35:13.690437+0000","last_fullsized":"2026-02-21T01:35:13.690437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:13.690406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:13.690406+0000","last_clean_scrub_stamp":"2026-02-21T01:35:13.690406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T09:51:28.617513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":610,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:14.683962+0000","last_change":"2026-02-21T01:35:14.683932+0000","last_active":"2026-02-21T01:35:14.683962+0000","last_peered":"2026-02-21T01:35:14.683962+0000","last_clean":"2026-02-21T01:35:14.683962+0000","last_became_active":"2026-02-21T01:28:23.916467+0000","last_became_peered":"2026-02-21T01:28:23.916467+0000","last_unstale":"2026-02-21T01:35:14.683962+0000","last_undegraded":"2026-02-21T01:35:14.683962+0000","last_fullsized":"2026-02-21T01:35:14.683962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:14.683892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:14.683892+0000","last_clean_scrub_stamp":"2026-02-21T01:35:14.683892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T11:41:49.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":615,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:18.970328+0000","last_change":"2026-02-21T01:35:18.970328+0000","last_active":"2026-02-21T01:35:18.970328+0000","last_peered":"2026-02-21T01:35:18.970328+0000","last_clean":"2026-02-21T01:35:18.970328+0000","last_became_active":"2026-02-21T01:28:23.916777+0000","last_became_peered":"2026-02-21T01:28:23.916777+0000","last_unstale":"2026-02-21T01:35:18.970328+0000","last_undegraded":"2026-02-21T01:35:18.970328+0000","last_fullsized":"2026-02-21T01:35:18.970328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:18.970257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:18.970257+0000","last_clean_scrub_stamp":"2026-02-21T01:35:18.970257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T02:20:22.776293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":603,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:15.012096+0000","last_change":"2026-02-21T01:35:15.012096+0000","last_active":"2026-02-21T01:35:15.012096+0000","last_peered":"2026-02-21T01:35:15.012096+0000","last_clean":"2026-02-21T01:35:15.012096+0000","last_became_active":"2026-02-21T01:28:23.895201+0000","last_became_peered":"2026-02-21T01:28:23.895201+0000","last_unstale":"2026-02-21T01:35:15.012096+0000","last_undegraded":"2026-02-21T01:35:15.012096+0000","last_fullsized":"2026-02-21T01:35:15.012096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:15.012058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:15.012058+0000","last_clean_scrub_stamp":"2026-02-21T01:35:15.012058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T01:59:08.246671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":604,"reported_epoch":321,"state":"active+clean","last_fresh":"2026-02-21T01:35:16.620900+0000","last_change":"2026-02-21T01:35:16.620900+0000","last_active":"2026-02-21T01:35:16.620900+0000","last_peered":"2026-02-21T01:35:16.620900+0000","last_clean":"2026-02-21T01:35:16.620900+0000","last_became_active":"2026-02-21T01:28:23.886126+0000","last_became_peered":"2026-02-21T01:28:23.886126+0000","last_unstale":"2026-02-21T01:35:16.620900+0000","last_undegraded":"2026-02-21T01:35:16.620900+0000","last_fullsized":"2026-02-21T01:35:16.620900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-21T01:35:16.620855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-21T01:35:16.620855+0000","last_clean_scrub_stamp":"2026-02-21T01:35:16.620855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-22T07:03:05.468273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640351,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":5814,"kb_used_meta":57225,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5954498,"internal_metadata":58598462},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640351,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68140,"kb_used_data":5084,"kb_used_omap":8625,"kb_used_meta":54414,"kb_avail":94303700,"statfs":{"total":96636764160,"available":96566988800,"internally_reserved":0,"allocated":5206016,"data_stored":2389891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8832023,"internal_metadata":55720937},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640351,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68656,"kb_used_data":5600,"kb_used_omap":205,"kb_used_meta":62834,"kb_avail":94303184,"statfs":{"total":96636764160,"available":96566460416,"internally_reserved":0,"allocated":5734400,"data_stored":2918814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210051,"internal_metadata":64342909},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640350,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68136,"kb_used_data":5080,"kb_used_omap":5681,"kb_used_meta":57358,"kb_avail":94303704,"statfs":{"total":96636764160,"available":96566992896,"internally_reserved":0,"allocated":5201920,"data_stored":2389886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5818260,"internal_metadata":58734700},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640350,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50092,"kb_used_data":5084,"kb_used_omap":201,"kb_used_meta":44790,"kb_avail":94321748,"statfs":{"total":96636764160,"available":96585469952,"internally_reserved":0,"allocated":5206016,"data_stored":2389905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":206623,"internal_metadata":45865185},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640350,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68660,"kb_used_data":5604,"kb_used_omap":3005,"kb_used_meta":60034,"kb_avail":94303180,"statfs":{"total":96636764160,"available":96566456320,"internally_reserved":0,"allocated":5738496,"data_stored":2918819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3077548,"internal_metadata":61475412},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-21T01:35:32.929 DEBUG:teuthology.orchestra.run.trial043:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient: get_monmap_and_config 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient: build_initial_monmap 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient: monmap: 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:35:32.996412+0000 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:35:32.996412+0000 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-c 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-b 2026-02-21T01:35:32.996 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 1 Processor -- start 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 1 -- start start 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient: init 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient(hunting): picked mon.noname-a con 0x7ff2a008ddb0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient(hunting): picked mon.noname-b con 0x7ff2a008d4d0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient(hunting): picked mon.noname-c con 0x7ff2a008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a008a690 con 0x7ff2a008ddb0 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a008b910 con 0x7ff2a008d8d0 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a0088ae0 con 0x7ff2a008d4d0 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a6c5b640 10 monclient(hunting): authenticate will time out at 1064.701821s 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a49d0640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff2a008ddb0 0x7ff2a008e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:45122/0 (socket says 10.20.193.43:45122) 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff2a49d0640 1 -- 10.20.193.43:0/1306586722 learned_addr learned my addr 10.20.193.43:0/1306586722 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.995+0000 7ff297fff640 1 --1- 10.20.193.43:0/1306586722 >> v1:10.20.193.43:6790/0 conn(0x7ff2a008d4d0 0x7ff2a017e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.43:6790/0 says I am v1:10.20.193.43:41226/0 (socket says 10.20.193.43:41226) 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321530846 0 0) 0x7ff2a0088ae0 con 0x7ff2a008d4d0 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:32.998 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): my global_id is 104240 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff28c003610 con 0x7ff2a008d4d0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441128032 0 0) 0x7ff2a008a690 con 0x7ff2a008ddb0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): _negotiate 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient(hunting): my global_id is 25275 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a0088ae0 con 0x7ff2a008ddb0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3328285427 0 0) 0x7ff28c003610 con 0x7ff2a008d4d0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 >> v1:10.20.193.46:6789/0 conn(0x7ff2a008d8d0 legacy=0x7ff2a019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 >> v1:10.20.193.43:6789/0 conn(0x7ff2a008ddb0 legacy=0x7ff2a008e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: _finish_hunting 0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 monclient: found mon.noname-b 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.43:6790/0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 --> v1:10.20.193.43:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a01a3ef0 con 0x7ff2a008d4d0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: _finish_auth 0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: _check_auth_tickets 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff288002df0 con 0x7ff2a008d4d0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: dump: 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 5 monclient: authenticate success, global_id 104240 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 <== mon.2 v1:10.20.193.43:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2880030b0 con 0x7ff2a008d4d0 2026-02-21T01:35:32.999 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 1 -- 10.20.193.43:0/1306586722 <== mon.2 v1:10.20.193.43:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2880034f0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2977fe640 10 monclient: dump: 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 10 monclient: get_monmap_and_config success 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 4 set_mon_vals no callback set 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 10 monclient: shutdown 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/1306586722 >> v1:10.20.193.43:6790/0 conn(0x7ff2a008d4d0 legacy=0x7ff2a017e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/1306586722 shutdown_connections 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/1306586722 >> 10.20.193.43:0/1306586722 conn(0x7ff2a008f480 msgr2=0x7ff2a008f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/1306586722 shutdown_connections 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.996+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/1306586722 wait complete. 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient: build_initial_monmap 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient: monmap: 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:epoch 0 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 0.000000 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:created 0.000000 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 0 (unknown) 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.noname-a 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.noname-b 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.noname-c 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 librados: starting msgr at 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 librados: starting objecter 2026-02-21T01:35:33.000 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 Processor -- start 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 -- start start 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 librados: setting wanted keys 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 librados: calling monclient init 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient: init 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient: _reopen_session rank -1 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient(hunting): picked mon.noname-a con 0x7ff2a008d4d0 addr v1:10.20.193.43:6789/0 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient(hunting): picked mon.noname-b con 0x7ff2a008d8d0 addr v1:10.20.193.46:6789/0 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient(hunting): picked mon.noname-c con 0x7ff2a008ddb0 addr v1:10.20.193.43:6790/0 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 -- --> v1:10.20.193.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a005e1b0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 -- --> v1:10.20.193.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a0056fc0 con 0x7ff2a008d8d0 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 -- --> v1:10.20.193.43:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a0107440 con 0x7ff2a008ddb0 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient(hunting): _renew_subs 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient(hunting): authenticate will time out at 1064.703573s 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a49d0640 1 --1- >> v1:10.20.193.43:6789/0 conn(0x7ff2a008d4d0 0x7ff2a011de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.43:6789/0 says I am v1:10.20.193.43:45130/0 (socket says 10.20.193.43:45130) 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a49d0640 1 -- 10.20.193.43:0/2851543430 learned_addr learned my addr 10.20.193.43:0/2851543430 (peer_addr_for_me v1:10.20.193.43:0/0) 2026-02-21T01:35:33.002 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 client.?.objecter ms_handle_connect 0x7ff2a008d4d0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 client.?.objecter ms_handle_connect 0x7ff2a008ddb0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722681858 0 0) 0x7ff2a005e1b0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): my global_id is 25278 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff270003610 con 0x7ff2a008d4d0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.2 v1:10.20.193.43:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852220110 0 0) 0x7ff2a0107440 con 0x7ff2a008ddb0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): my global_id is 104243 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a005e1b0 con 0x7ff2a008ddb0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 client.?.objecter ms_handle_connect 0x7ff2a008d8d0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 client.?.objecter resend_mon_ops 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3571799810 0 0) 0x7ff270003610 con 0x7ff2a008d4d0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2a0107440 con 0x7ff2a008d4d0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff2900031c0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): dump: 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _finish_auth 0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.2 v1:10.20.193.43:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3957679038 0 0) 0x7ff2a005e1b0 con 0x7ff2a008ddb0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff270003610 con 0x7ff2a008ddb0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.2 v1:10.20.193.43:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff29c003290 con 0x7ff2a008ddb0 2026-02-21T01:35:33.003 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): dump: 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.1 v1:10.20.193.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220614424 0 0) 0x7ff2a0056fc0 con 0x7ff2a008d8d0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _negotiate 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _init_auth method 2 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient(hunting): my global_id is 84436 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a005e1b0 con 0x7ff2a008d8d0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 20197427 0 0) 0x7ff2a0107440 con 0x7ff2a008d4d0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 >> v1:10.20.193.43:6790/0 conn(0x7ff2a008ddb0 legacy=0x7ff2a018eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 >> v1:10.20.193.46:6789/0 conn(0x7ff2a008d8d0 legacy=0x7ff2a018d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient: _finish_hunting 0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 monclient: found mon.a 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a01097a0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient: _finish_auth 0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 10 monclient: _check_auth_tickets 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 5 monclient: authenticate success, global_id 25278 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient: _renew_subs 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.997+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a0107fa0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 10 client.25278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 10 monclient: _renew_subs 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff2a014c470 con 0x7ff2a008d4d0 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 1 librados: init done 2026-02-21T01:35:33.004 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff290004b80 con 0x7ff2a008d4d0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 10 monclient: handle_config config(0 keys) 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1081358796 0 0) 0x7ff290004ed0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff296ffd640 4 set_mon_vals no callback set 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 10 monclient: dump: 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:epoch 1 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:fsid 6ad0f5d2-7471-410a-a664-22f2b680bffe 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:last_changed 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:created 2026-02-21T01:27:33.280306+0000 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:min_mon_release 20 (tentacle) 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:election_strategy: 1 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:0: v1:10.20.193.43:6789/0 mon.a 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:1: v1:10.20.193.46:6789/0 mon.b 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2: v1:10.20.193.43:6790/0 mon.c 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a014c800 con 0x7ff2a008d4d0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 7 ==== mgrmap(e 5) ==== 51151+0+0 (unknown 1423216335 0 0) 0x7ff290011850 con 0x7ff2a008d4d0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 8 ==== osd_map(321..321 src has 1..321) ==== 4381+0+0 (unknown 4031866974 0 0) 0x7ff29004e150 con 0x7ff2a008d4d0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 10 client.25278.objecter ms_dispatch2 0x7ff2a0000b90 osd_map(321..321 src has 1..321) 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 3 client.25278.objecter handle_osd_map got epochs [321,321] > 0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 3 client.25278.objecter handle_osd_map decoding full epoch 321 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.998+0000 7ff2957fa640 20 client.25278.objecter dump_active .. 0 homeless 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.999+0000 7ff297fff640 10 monclient: get_auth_request con 0x7ff27003eb50 auth_method 0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:32.999+0000 7ff2957fa640 10 client.25278.objecter ms_handle_connect 0x7ff27003eb50 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.000+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff2900177f0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.000+0000 7ff2957fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-21T01:35:33.005 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.000+0000 7ff2957fa640 10 monclient: _finish_command 1 = system:0 2026-02-21T01:35:33.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.110+0000 7ff2a6c5b640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-21T01:35:33.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.110+0000 7ff2a6c5b640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-21T01:35:33.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.110+0000 7ff2a6c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.43:6789/0 2026-02-21T01:35:33.112 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.110+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 --> v1:10.20.193.43:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff2a008edb0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.112+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7ff29001c7d0 con 0x7ff2a008d4d0 2026-02-21T01:35:33.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.112+0000 7ff2957fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-21T01:35:33.113 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.112+0000 7ff2957fa640 10 monclient: _finish_command 2 = system:0 2026-02-21T01:35:33.114 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.113+0000 7ff2957fa640 1 -- 10.20.193.43:0/2851543430 <== mon.0 v1:10.20.193.43:6789/0 11 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7ff290021960 con 0x7ff2a008d4d0 2026-02-21T01:35:33.114 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.113+0000 7ff2957fa640 10 monclient: handle_config config(1 keys) 2026-02-21T01:35:33.114 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.113+0000 7ff2967fc640 4 set_mon_vals no callback set 2026-02-21T01:35:33.114 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.113+0000 7ff2967fc640 10 set_mon_vals mon_health_to_clog = false 2026-02-21T01:35:33.115 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 10 librados: watch_flush enter 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 10 librados: watch_flush exit 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 20 client.25278.objecter shutdown clearing up homeless session... 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 10 client.25278.objecter successfully canceled tick 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 >> v1:10.20.193.46:6812/860801619 conn(0x7ff27003eb50 legacy=0x7ff27005f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 10 monclient: shutdown 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 >> v1:10.20.193.43:6789/0 conn(0x7ff2a008d4d0 legacy=0x7ff2a011de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 shutdown_connections 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 >> 10.20.193.43:0/2851543430 conn(0x7ff2a008f480 msgr2=0x7ff2a01a2710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 shutdown_connections 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 1 -- 10.20.193.43:0/2851543430 wait complete. 2026-02-21T01:35:33.116 INFO:teuthology.orchestra.run.trial043.stderr:2026-02-21T01:35:33.114+0000 7ff2a6c5b640 1 librados: shutdown 2026-02-21T01:35:33.126 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-21T01:35:33.126 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-21T01:35:33.126 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-21T01:35:33.126 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.169 INFO:tasks.ceph.osd.0:Stopped 2026-02-21T01:35:33.169 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-21T01:35:33.170 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.213 INFO:tasks.ceph.osd.1:Stopped 2026-02-21T01:35:33.213 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-21T01:35:33.213 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.254 INFO:tasks.ceph.osd.2:Stopped 2026-02-21T01:35:33.254 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-21T01:35:33.254 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.304 INFO:tasks.ceph.osd.3:Stopped 2026-02-21T01:35:33.305 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-21T01:35:33.305 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.381 INFO:tasks.ceph.osd.4:Stopped 2026-02-21T01:35:33.382 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-21T01:35:33.382 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.454 INFO:tasks.ceph.osd.5:Stopped 2026-02-21T01:35:33.454 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-21T01:35:33.455 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-21T01:35:33.455 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.525 INFO:tasks.ceph.mgr.x:Stopped 2026-02-21T01:35:33.525 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-21T01:35:33.525 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-21T01:35:33.525 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.540 INFO:tasks.ceph.mon.a:Stopped 2026-02-21T01:35:33.541 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-21T01:35:33.541 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.589 INFO:tasks.ceph.mon.c:Stopped 2026-02-21T01:35:33.589 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-21T01:35:33.589 INFO:teuthology.orchestra.run:waiting for 300 2026-02-21T01:35:33.599 INFO:tasks.ceph.mon.b:Stopped 2026-02-21T01:35:33.599 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-21T01:35:33.600 DEBUG:teuthology.orchestra.run.trial043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'slow request' | head -n 1 2026-02-21T01:35:33.656 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:35:33.656 DEBUG:teuthology.orchestra.run.trial043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-21T01:35:33.726 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:35:33.726 DEBUG:teuthology.orchestra.run.trial043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-21T01:35:33.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:35:33.793 DEBUG:teuthology.orchestra.run.trial043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-21T01:35:33.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:35:33.869 DEBUG:teuthology.orchestra.run.trial046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-21T01:35:33.905 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:35:33.905 DEBUG:teuthology.orchestra.run.trial046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-21T01:35:33.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:35:33.976 DEBUG:teuthology.orchestra.run.trial046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-21T01:35:34.045 INFO:tasks.ceph:Archiving mon data... 2026-02-21T01:35:34.046 DEBUG:teuthology.misc:Transferring archived files from trial043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/data/mon.a.tgz 2026-02-21T01:35:34.047 DEBUG:teuthology.orchestra.run.trial043:> mktemp 2026-02-21T01:35:34.064 INFO:teuthology.orchestra.run.trial043.stdout:/tmp/tmp.fAYNeV9XXD 2026-02-21T01:35:34.064 DEBUG:teuthology.orchestra.run.trial043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fAYNeV9XXD 2026-02-21T01:35:34.166 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod 0666 /tmp/tmp.fAYNeV9XXD 2026-02-21T01:35:34.246 DEBUG:teuthology.orchestra.remote:trial043:/tmp/tmp.fAYNeV9XXD is 332KB 2026-02-21T01:35:34.337 DEBUG:teuthology.orchestra.run.trial043:> rm -fr /tmp/tmp.fAYNeV9XXD 2026-02-21T01:35:34.354 DEBUG:teuthology.misc:Transferring archived files from trial043:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/data/mon.c.tgz 2026-02-21T01:35:34.354 DEBUG:teuthology.orchestra.run.trial043:> mktemp 2026-02-21T01:35:34.410 INFO:teuthology.orchestra.run.trial043.stdout:/tmp/tmp.qOG2wbf0ZR 2026-02-21T01:35:34.410 DEBUG:teuthology.orchestra.run.trial043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qOG2wbf0ZR 2026-02-21T01:35:34.508 DEBUG:teuthology.orchestra.run.trial043:> sudo chmod 0666 /tmp/tmp.qOG2wbf0ZR 2026-02-21T01:35:34.589 DEBUG:teuthology.orchestra.remote:trial043:/tmp/tmp.qOG2wbf0ZR is 321KB 2026-02-21T01:35:34.682 DEBUG:teuthology.orchestra.run.trial043:> rm -fr /tmp/tmp.qOG2wbf0ZR 2026-02-21T01:35:34.700 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/data/mon.b.tgz 2026-02-21T01:35:34.700 DEBUG:teuthology.orchestra.run.trial046:> mktemp 2026-02-21T01:35:34.718 INFO:teuthology.orchestra.run.trial046.stdout:/tmp/tmp.UTNOXH8c5c 2026-02-21T01:35:34.719 DEBUG:teuthology.orchestra.run.trial046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.UTNOXH8c5c 2026-02-21T01:35:34.819 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 0666 /tmp/tmp.UTNOXH8c5c 2026-02-21T01:35:34.902 DEBUG:teuthology.orchestra.remote:trial046:/tmp/tmp.UTNOXH8c5c is 325KB 2026-02-21T01:35:34.997 DEBUG:teuthology.orchestra.run.trial046:> rm -fr /tmp/tmp.UTNOXH8c5c 2026-02-21T01:35:35.013 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-21T01:35:35.013 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-21T01:35:35.015 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-21T01:35:35.097 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-21T01:35:35.134 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-21T01:35:35.134 INFO:tasks.ceph:Archiving crash dumps... 2026-02-21T01:35:35.137 DEBUG:teuthology.misc:Transferring archived files from trial043:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/remote/trial043/crash 2026-02-21T01:35:35.138 DEBUG:teuthology.orchestra.run.trial043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-21T01:35:35.162 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/remote/trial046/crash 2026-02-21T01:35:35.163 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-21T01:35:35.197 INFO:tasks.ceph:Compressing logs... 2026-02-21T01:35:35.197 DEBUG:teuthology.orchestra.run.trial043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-21T01:35:35.205 DEBUG:teuthology.orchestra.run.trial046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-21T01:35:35.225 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50215.log 2026-02-21T01:35:35.225 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-21T01:35:35.225 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46576.log 2026-02-21T01:35:35.226 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-osd.2.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50215.log.gz 2026-02-21T01:35:35.226 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2026-02-21T01:35:35.226 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48765.log 2026-02-21T01:35:35.226 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47887.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-21T01:35:35.226 INFO:teuthology.orchestra.run.trial043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46576.log.gz 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46674.log 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-mon.a.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48765.log.gz 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47264.log 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46674.log.gz 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.51247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51099.log 2026-02-21T01:35:35.227 INFO:teuthology.orchestra.run.trial043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2026-02-21T01:35:35.228 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47264.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-21T01:35:35.228 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.51099.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.47264.log.gz 2026-02-21T01:35:35.228 INFO:teuthology.orchestra.run.trial043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49798.log 2026-02-21T01:35:35.228 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.0.log: -- /var/log/ceph/ceph-client.admin.48863.log 2026-02-21T01:35:35.228 INFO:teuthology.orchestra.run.trial043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51099.log.gz 2026-02-21T01:35:35.228 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46238.log 2026-02-21T01:35:35.228 INFO:teuthology.orchestra.run.trial043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49798.log.gz 2026-02-21T01:35:35.229 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51148.log 2026-02-21T01:35:35.229 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46238.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48863.log.gz 2026-02-21T01:35:35.229 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2026-02-21T01:35:35.229 INFO:teuthology.orchestra.run.trial043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46238.log.gz 2026-02-21T01:35:35.229 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.51148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45727.log 2026-02-21T01:35:35.229 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49010.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51148.log.gz 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47985.log 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47985.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45727.log.gz 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51001.log 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48428.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47985.log.gz 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50706.log 2026-02-21T01:35:35.230 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.51001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42377.log 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50706.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51001.log.gz 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46019.log 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.42377.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50706.log.gz 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48181.log 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42377.log.gz 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49159.log 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48181.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46019.log.gz 2026-02-21T01:35:35.231 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2026-02-21T01:35:35.232 INFO:teuthology.orchestra.run.trial043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48181.log.gz 2026-02-21T01:35:35.232 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2026-02-21T01:35:35.232 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48328.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49159.log.gz 2026-02-21T01:35:35.232 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49602.log 2026-02-21T01:35:35.232 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46236.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz -5 2026-02-21T01:35:35.232 INFO:teuthology.orchestra.run.trial043.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50853.log 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49602.log.gz 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48279.log 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50853.log.gz 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50608.log 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2026-02-21T01:35:35.233 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48279.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-21T01:35:35.234 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50608.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.48279.log.gz 2026-02-21T01:35:35.234 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46772.log 2026-02-21T01:35:35.234 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46022.log 2026-02-21T01:35:35.234 INFO:teuthology.orchestra.run.trial043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50608.log.gz 2026-02-21T01:35:35.234 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50363.log 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46527.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46022.log.gz 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48132.log 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48083.log 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48132.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50363.log.gz 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46357.log 2026-02-21T01:35:35.235 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48083.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48132.log.gz 2026-02-21T01:35:35.236 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48230.log 2026-02-21T01:35:35.236 INFO:teuthology.orchestra.run.trial043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48083.log.gz 2026-02-21T01:35:35.236 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46018.log 2026-02-21T01:35:35.236 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48230.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46357.log.gz 2026-02-21T01:35:35.236 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2026-02-21T01:35:35.236 INFO:teuthology.orchestra.run.trial043.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.48230.log.gz 2026-02-21T01:35:35.236 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48716.log 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.46018.log.gz 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47743.log 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50078.log 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48716.log.gz 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47834.log 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49700.log 2026-02-21T01:35:35.237 INFO:teuthology.orchestra.run.trial043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47743.log.gz 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50078.log.gz 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49700.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47834.log.gz 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49700.log.gz 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49749.log 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47017.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2026-02-21T01:35:35.238 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2026-02-21T01:35:35.239 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49749.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2026-02-21T01:35:35.239 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50166.log 2026-02-21T01:35:35.239 INFO:teuthology.orchestra.run.trial043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49749.log.gz 2026-02-21T01:35:35.239 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46968.log 2026-02-21T01:35:35.239 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50166.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2026-02-21T01:35:35.239 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2026-02-21T01:35:35.239 INFO:teuthology.orchestra.run.trial043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50166.log.gz 2026-02-21T01:35:35.240 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2026-02-21T01:35:35.240 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46020.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46968.log.gz 2026-02-21T01:35:35.240 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50510.log 2026-02-21T01:35:35.240 INFO:teuthology.orchestra.run.trial043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2026-02-21T01:35:35.240 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50804.log 2026-02-21T01:35:35.240 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2026-02-21T01:35:35.240 INFO:teuthology.orchestra.run.trial043.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50804.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50510.log.gz 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49945.log 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49315.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50804.log.gz 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49945.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51197.log 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49945.log.gz 2026-02-21T01:35:35.241 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48034.log 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.51197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50903.log 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48034.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51197.log.gz 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50952.log 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50903.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48034.log.gz 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50903.log.gz 2026-02-21T01:35:35.242 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46025.log 2026-02-21T01:35:35.243 INFO:teuthology.orchestra.run.trial043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50952.log.gz 2026-02-21T01:35:35.243 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50461.log 2026-02-21T01:35:35.243 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46025.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2026-02-21T01:35:35.243 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2026-02-21T01:35:35.243 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50461.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.46025.log.gz 2026-02-21T01:35:35.243 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2026-02-21T01:35:35.243 INFO:teuthology.orchestra.run.trial043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50461.log.gz 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45498.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46723.log 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47116.log 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47165.log 2026-02-21T01:35:35.244 INFO:teuthology.orchestra.run.trial043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46723.log.gz 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49059.log 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45726.log 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49059.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47165.log.gz 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49551.log 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49059.log.gz 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51294.log 2026-02-21T01:35:35.245 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49551.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45726.log.gz 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49551.log.gz 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.51294.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr: 87.2%/var/log/ceph/ceph-client.admin.46478.log: -- replaced with /var/log/ceph/ceph-client.admin.51294.log.gz 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49847.log 2026-02-21T01:35:35.246 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46373.log 2026-02-21T01:35:35.247 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45400.log 2026-02-21T01:35:35.247 INFO:teuthology.orchestra.run.trial043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2026-02-21T01:35:35.247 INFO:teuthology.orchestra.run.trial043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49847.log.gz 2026-02-21T01:35:35.247 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2026-02-21T01:35:35.247 INFO:teuthology.orchestra.run.trial043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46373.log.gz 2026-02-21T01:35:35.247 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45730.log 2026-02-21T01:35:35.248 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46919.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45400.log.gz 2026-02-21T01:35:35.248 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-21T01:35:35.248 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45730.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2026-02-21T01:35:35.248 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50412.log 2026-02-21T01:35:35.248 INFO:teuthology.orchestra.run.trial043.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45730.log.gz 2026-02-21T01:35:35.248 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48667.log 2026-02-21T01:35:35.248 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47215.log 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50412.log.gz 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47215.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48667.log.gz 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 87.6% 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47215.log.gz 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2026-02-21T01:35:35.249 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48961.log 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46237.log 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48912.log 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46237.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48961.log.gz 2026-02-21T01:35:35.250 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47936.log 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46237.log.gz 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.47936.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48912.log.gz 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49994.log 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47936.log.gz 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2026-02-21T01:35:35.251 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48618.log 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49994.log.gz 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50264.log 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48618.log.gz 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48569.log 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50264.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2026-02-21T01:35:35.252 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45310.log 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.48569.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50264.log.gz 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50559.log 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45310.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.48569.log.gz 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49896.log 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50559.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45310.log.gz 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46870.log 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50559.log.gz 2026-02-21T01:35:35.253 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49208.log 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46870.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49896.log.gz 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46024.log 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46870.log.gz 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42579.log 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49208.log.gz 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.46024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49651.log 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46024.log.gz 2026-02-21T01:35:35.254 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.42579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50755.log 2026-02-21T01:35:35.255 INFO:teuthology.orchestra.run.trial043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42579.log.gz 2026-02-21T01:35:35.255 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51050.log 2026-02-21T01:35:35.255 INFO:teuthology.orchestra.run.trial043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49651.log.gz 2026-02-21T01:35:35.255 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.50755.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-21T01:35:35.255 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.51050.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50755.log.gz 2026-02-21T01:35:35.255 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45729.log 2026-02-21T01:35:35.255 INFO:teuthology.orchestra.run.trial043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51050.log.gz 2026-02-21T01:35:35.256 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37503.log 2026-02-21T01:35:35.256 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49404.log 2026-02-21T01:35:35.256 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph.tmp-client.admin.37503.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45729.log.gz 2026-02-21T01:35:35.256 INFO:teuthology.orchestra.run.trial043.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37503.log.gz 2026-02-21T01:35:35.256 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49502.log 2026-02-21T01:35:35.256 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2026-02-21T01:35:35.256 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.49502.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49404.log.gz 2026-02-21T01:35:35.257 INFO:teuthology.orchestra.run.trial043.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49502.log.gz 2026-02-21T01:35:35.257 INFO:teuthology.orchestra.run.trial043.stderr:/var/log/ceph/ceph-client.admin.45449.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2026-02-21T01:35:35.257 INFO:teuthology.orchestra.run.trial043.stderr: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-21T01:35:35.261 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45998.log 2026-02-21T01:35:35.261 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41846.log 2026-02-21T01:35:35.261 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46318.log 2026-02-21T01:35:35.262 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45105.log 2026-02-21T01:35:35.262 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46318.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.41846.log.gz 2026-02-21T01:35:35.262 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45228.log 2026-02-21T01:35:35.262 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2026-02-21T01:35:35.262 INFO:teuthology.orchestra.run.trial046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45998.log.gz 2026-02-21T01:35:35.263 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45228.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-21T01:35:35.263 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45197.log 2026-02-21T01:35:35.263 INFO:teuthology.orchestra.run.trial046.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.46318.log.gz 2026-02-21T01:35:35.263 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2026-02-21T01:35:35.263 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46848.log 2026-02-21T01:35:35.263 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46781.log 2026-02-21T01:35:35.264 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45883.log 2026-02-21T01:35:35.264 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-21T01:35:35.264 INFO:teuthology.orchestra.run.trial046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2026-02-21T01:35:35.264 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46781.log: /var/log/ceph/ceph-client.admin.45883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2026-02-21T01:35:35.264 INFO:teuthology.orchestra.run.trial046.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2026-02-21T01:35:35.265 INFO:teuthology.orchestra.run.trial046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45883.log.gz 2026-02-21T01:35:35.265 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46646.log 2026-02-21T01:35:35.265 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2026-02-21T01:35:35.265 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45978.log 2026-02-21T01:35:35.265 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45921.log 2026-02-21T01:35:35.265 INFO:teuthology.orchestra.run.trial046.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46848.log.gz 2026-02-21T01:35:35.265 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45781.log 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45921.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45978.log.gz 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45360.log 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46781.log.gz 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.45921.log.gz 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46646.log.gz 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.45781.log.gz 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2026-02-21T01:35:35.266 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2026-02-21T01:35:35.267 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46699.log 2026-02-21T01:35:35.267 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45440.log 2026-02-21T01:35:35.267 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41987.log 2026-02-21T01:35:35.267 INFO:teuthology.orchestra.run.trial046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2026-02-21T01:35:35.267 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45440.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-21T01:35:35.267 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41987.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2026-02-21T01:35:35.267 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-osd.4.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.41987.log.gz 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45918.log 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46355.log 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.45105.log.gz 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45918.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45440.log.gz 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46699.log.gz 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2026-02-21T01:35:35.268 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2026-02-21T01:35:35.269 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46698.log 2026-02-21T01:35:35.269 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45643.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2026-02-21T01:35:35.269 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46087.log 2026-02-21T01:35:35.269 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46698.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45918.log.gz 2026-02-21T01:35:35.269 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46852.log 2026-02-21T01:35:35.269 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46596.log 2026-02-21T01:35:35.270 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46087.log: /var/log/ceph/ceph-client.admin.46852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45066.log 2026-02-21T01:35:35.270 INFO:teuthology.orchestra.run.trial046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45360.log.gz 2026-02-21T01:35:35.270 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2026-02-21T01:35:35.270 INFO:teuthology.orchestra.run.trial046.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2026-02-21T01:35:35.270 INFO:teuthology.orchestra.run.trial046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46355.log.gz 2026-02-21T01:35:35.270 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45082.log 2026-02-21T01:35:35.271 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46852.log.gz 2026-02-21T01:35:35.271 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45565.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.46698.log.gz 2026-02-21T01:35:35.271 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45146.log 2026-02-21T01:35:35.271 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45082.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-21T01:35:35.271 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46850.log 2026-02-21T01:35:35.271 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46596.log.gz 2026-02-21T01:35:35.272 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-21T01:35:35.272 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45931.log 2026-02-21T01:35:35.272 INFO:teuthology.orchestra.run.trial046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2026-02-21T01:35:35.272 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2026-02-21T01:35:35.272 INFO:teuthology.orchestra.run.trial046.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.46850.log.gz 2026-02-21T01:35:35.272 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2026-02-21T01:35:35.273 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2026-02-21T01:35:35.273 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2026-02-21T01:35:35.273 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2026-02-21T01:35:35.273 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46645.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.45082.log.gz 2026-02-21T01:35:35.273 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41940.log 2026-02-21T01:35:35.274 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2026-02-21T01:35:35.274 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45042.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2026-02-21T01:35:35.274 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46002.log 2026-02-21T01:35:35.274 INFO:teuthology.orchestra.run.trial046.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41940.log.gz 2026-02-21T01:35:35.274 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45389.log 2026-02-21T01:35:35.274 INFO:teuthology.orchestra.run.trial046.stderr: 91.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46228.log 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46002.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45389.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46002.log.gz 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45338.log 2026-02-21T01:35:35.275 INFO:teuthology.orchestra.run.trial046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.45931.log.gz 2026-02-21T01:35:35.276 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41752.log 2026-02-21T01:35:35.276 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2026-02-21T01:35:35.276 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46782.log 2026-02-21T01:35:35.276 INFO:teuthology.orchestra.run.trial046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45389.log.gz 2026-02-21T01:35:35.276 INFO:teuthology.orchestra.run.trial046.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.41752.log.gz 2026-02-21T01:35:35.276 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46700.log 2026-02-21T01:35:35.277 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46782.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-21T01:35:35.277 INFO:teuthology.orchestra.run.trial046.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2026-02-21T01:35:35.277 INFO:teuthology.orchestra.run.trial046.stderr:gzip/var/log/ceph/ceph-client.admin.46700.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2026-02-21T01:35:35.277 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log/var/log/ceph/ceph-mgr.x.log: 2026-02-21T01:35:35.277 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46851.log 2026-02-21T01:35:35.278 INFO:teuthology.orchestra.run.trial046.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.46782.log.gz 2026-02-21T01:35:35.278 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45482.log 2026-02-21T01:35:35.278 INFO:teuthology.orchestra.run.trial046.stderr:gzip/var/log/ceph/ceph-client.admin.46851.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41799.log 2026-02-21T01:35:35.278 INFO:teuthology.orchestra.run.trial046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.45338.log.gz 2026-02-21T01:35:35.278 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45482.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46851.log.gz 2026-02-21T01:35:35.278 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46849.log 2026-02-21T01:35:35.278 INFO:teuthology.orchestra.run.trial046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46700.log.gz 2026-02-21T01:35:35.279 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2026-02-21T01:35:35.279 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46647.log 2026-02-21T01:35:35.279 INFO:teuthology.orchestra.run.trial046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41799.log.gz 2026-02-21T01:35:35.279 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46595.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-21T01:35:35.279 INFO:teuthology.orchestra.run.trial046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2026-02-21T01:35:35.279 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45892.log 2026-02-21T01:35:35.280 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46309.log 2026-02-21T01:35:35.280 INFO:teuthology.orchestra.run.trial046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2026-02-21T01:35:35.280 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45892.log: gzip -5 92.4% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2026-02-21T01:35:35.280 INFO:teuthology.orchestra.run.trial046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2026-02-21T01:35:35.280 INFO:teuthology.orchestra.run.trial046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46849.log.gz 2026-02-21T01:35:35.280 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz 2026-02-21T01:35:35.280 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45697.log 2026-02-21T01:35:35.281 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2026-02-21T01:35:35.281 INFO:teuthology.orchestra.run.trial046.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.45482.log.gz 2026-02-21T01:35:35.281 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45697.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46647.log.gz 2026-02-21T01:35:35.281 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45126.log 2026-02-21T01:35:35.281 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45892.log.gz 2026-02-21T01:35:35.281 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41893.log 2026-02-21T01:35:35.282 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45126.log: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-21T01:35:35.282 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41893.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2026-02-21T01:35:35.282 INFO:teuthology.orchestra.run.trial046.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.41893.log.gz 2026-02-21T01:35:35.283 INFO:teuthology.orchestra.run.trial046.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gz 2026-02-21T01:35:35.283 INFO:teuthology.orchestra.run.trial046.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.45126.log.gz 2026-02-21T01:35:35.285 INFO:teuthology.orchestra.run.trial046.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.46087.log.gz 2026-02-21T01:35:35.285 INFO:teuthology.orchestra.run.trial046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46309.log.gz 2026-02-21T01:35:35.286 INFO:teuthology.orchestra.run.trial046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.46228.log.gz 2026-02-21T01:35:35.291 INFO:teuthology.orchestra.run.trial046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2026-02-21T01:35:35.297 INFO:teuthology.orchestra.run.trial046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.45146.log.gz 2026-02-21T01:35:35.298 INFO:teuthology.orchestra.run.trial046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2026-02-21T01:35:35.300 INFO:teuthology.orchestra.run.trial046.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2026-02-21T01:35:35.300 INFO:teuthology.orchestra.run.trial046.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.45697.log.gz 2026-02-21T01:35:35.303 INFO:teuthology.orchestra.run.trial046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.45066.log.gz 2026-02-21T01:35:35.332 INFO:teuthology.orchestra.run.trial043.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-21T01:35:35.370 INFO:teuthology.orchestra.run.trial046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-21T01:35:35.717 INFO:teuthology.orchestra.run.trial046.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2026-02-21T01:35:35.983 INFO:teuthology.orchestra.run.trial046.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-21T01:35:36.025 INFO:teuthology.orchestra.run.trial043.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-21T01:35:37.661 INFO:teuthology.orchestra.run.trial046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-21T01:35:37.705 INFO:teuthology.orchestra.run.trial046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-21T01:35:37.706 INFO:teuthology.orchestra.run.trial043.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-21T01:35:37.789 INFO:teuthology.orchestra.run.trial043.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-21T01:35:37.882 INFO:teuthology.orchestra.run.trial043.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-21T01:35:37.884 INFO:teuthology.orchestra.run.trial043.stderr: 2026-02-21T01:35:37.884 INFO:teuthology.orchestra.run.trial043.stderr:real 0m2.666s 2026-02-21T01:35:37.884 INFO:teuthology.orchestra.run.trial043.stderr:user 0m8.241s 2026-02-21T01:35:37.884 INFO:teuthology.orchestra.run.trial043.stderr:sys 0m0.427s 2026-02-21T01:35:38.140 INFO:teuthology.orchestra.run.trial046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-21T01:35:38.142 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-21T01:35:38.143 INFO:teuthology.orchestra.run.trial046.stderr:real 0m2.889s 2026-02-21T01:35:38.143 INFO:teuthology.orchestra.run.trial046.stderr:user 0m8.835s 2026-02-21T01:35:38.143 INFO:teuthology.orchestra.run.trial046.stderr:sys 0m0.450s 2026-02-21T01:35:38.143 INFO:tasks.ceph:Archiving logs... 2026-02-21T01:35:38.143 DEBUG:teuthology.misc:Transferring archived files from trial043:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/remote/trial043/log 2026-02-21T01:35:38.145 DEBUG:teuthology.orchestra.run.trial043:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-21T01:35:39.038 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/remote/trial046/log 2026-02-21T01:35:39.038 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-21T01:35:39.961 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-21T01:35:39.969 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-21T01:35:39.969 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-21T01:35:39.971 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-21T01:35:40.128 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-21T01:35:40.140 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-21T01:35:40.140 DEBUG:teuthology.orchestra.run.trial043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-21T01:35:40.142 DEBUG:teuthology.orchestra.run.trial046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-21T01:35:40.157 INFO:teuthology.orchestra.run.trial043.stderr:bash: line 1: ntpq: command not found 2026-02-21T01:35:40.158 INFO:teuthology.orchestra.run.trial046.stderr:bash: line 1: ntpq: command not found 2026-02-21T01:35:40.187 INFO:teuthology.orchestra.run.trial043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-21T01:35:40.187 INFO:teuthology.orchestra.run.trial043.stdout:=============================================================================== 2026-02-21T01:35:40.187 INFO:teuthology.orchestra.run.trial043.stdout:^+ ntp.maxhost.io 2 6 357 43 +604us[ +604us] +/- 57ms 2026-02-21T01:35:40.187 INFO:teuthology.orchestra.run.trial043.stdout:^* lax1.us.ntp.li 2 6 377 44 +73us[ -196us] +/- 46ms 2026-02-21T01:35:40.187 INFO:teuthology.orchestra.run.trial043.stdout:^- time3.lshiy.com 2 6 377 44 +345us[ +75us] +/- 124ms 2026-02-21T01:35:40.187 INFO:teuthology.orchestra.run.trial043.stdout:^+ 172-232-15-202.ip.linode> 2 6 377 43 -6271us[-6271us] +/- 76ms 2026-02-21T01:35:40.194 INFO:teuthology.orchestra.run.trial046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-21T01:35:40.194 INFO:teuthology.orchestra.run.trial046.stdout:=============================================================================== 2026-02-21T01:35:40.194 INFO:teuthology.orchestra.run.trial046.stdout:^- 38.45.64.130 2 6 177 44 +430us[ +430us] +/- 19ms 2026-02-21T01:35:40.194 INFO:teuthology.orchestra.run.trial046.stdout:^- 172-232-15-202.ip.linode> 2 6 377 43 -6581us[-6581us] +/- 76ms 2026-02-21T01:35:40.194 INFO:teuthology.orchestra.run.trial046.stdout:^+ chi2.us.ntp.li 2 6 377 44 -99us[ -99us] +/- 11ms 2026-02-21T01:35:40.194 INFO:teuthology.orchestra.run.trial046.stdout:^* 50.205.57.38 1 6 377 45 +480us[ +558us] +/- 5199us 2026-02-21T01:35:40.195 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-21T01:35:40.207 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-21T01:35:40.207 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-21T01:35:40.219 DEBUG:teuthology.orchestra.run.trial043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-21T01:35:40.281 DEBUG:teuthology.orchestra.run.trial046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-21T01:35:40.334 DEBUG:teuthology.orchestra.run.trial043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-21T01:35:40.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:35:40.361 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-21T01:35:40.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:35:40.387 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-21T01:35:40.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-21T01:35:40.423 INFO:teuthology.task.internal:Duration was 731.441007 seconds 2026-02-21T01:35:40.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-21T01:35:40.438 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-21T01:35:40.439 DEBUG:teuthology.orchestra.run.trial043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-21T01:35:40.442 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-21T01:35:40.476 INFO:teuthology.orchestra.run.trial043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-21T01:35:40.478 INFO:teuthology.orchestra.run.trial046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-21T01:35:40.746 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-21T01:35:40.746 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial043.front.sepia.ceph.com 2026-02-21T01:35:40.746 DEBUG:teuthology.orchestra.run.trial043:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-21T01:35:40.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial046.front.sepia.ceph.com 2026-02-21T01:35:40.805 DEBUG:teuthology.orchestra.run.trial046:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-21T01:35:40.837 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-21T01:35:40.838 DEBUG:teuthology.orchestra.run.trial043:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-21T01:35:40.850 DEBUG:teuthology.orchestra.run.trial046:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-21T01:35:40.941 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-21T01:35:40.941 DEBUG:teuthology.orchestra.run.trial043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-21T01:35:40.943 DEBUG:teuthology.orchestra.run.trial046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-21T01:35:40.964 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T01:35:40.964 INFO:teuthology.orchestra.run.trial043.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T01:35:40.965 INFO:teuthology.orchestra.run.trial043.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-21T01:35:40.965 INFO:teuthology.orchestra.run.trial043.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-21T01:35:40.965 INFO:teuthology.orchestra.run.trial043.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-21T01:35:40.965 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-21T01:35:40.966 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-21T01:35:40.966 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-21T01:35:40.966 INFO:teuthology.orchestra.run.trial046.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-21T01:35:40.966 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-21T01:35:40.975 INFO:teuthology.orchestra.run.trial043.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-21T01:35:40.976 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-21T01:35:40.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-21T01:35:40.991 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-21T01:35:40.992 DEBUG:teuthology.orchestra.run.trial043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-21T01:35:41.041 DEBUG:teuthology.orchestra.run.trial046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-21T01:35:41.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-21T01:35:41.077 DEBUG:teuthology.orchestra.run.trial043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-21T01:35:41.082 DEBUG:teuthology.orchestra.run.trial046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-21T01:35:41.104 INFO:teuthology.orchestra.run.trial043.stdout:kernel.core_pattern = core 2026-02-21T01:35:41.130 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern = core 2026-02-21T01:35:41.143 DEBUG:teuthology.orchestra.run.trial043:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-21T01:35:41.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:35:41.177 DEBUG:teuthology.orchestra.run.trial046:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-21T01:35:41.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-21T01:35:41.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-21T01:35:41.216 INFO:teuthology.task.internal:Transferring archived files... 2026-02-21T01:35:41.217 DEBUG:teuthology.misc:Transferring archived files from trial043:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/remote/trial043 2026-02-21T01:35:41.217 DEBUG:teuthology.orchestra.run.trial043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-21T01:35:41.251 DEBUG:teuthology.misc:Transferring archived files from trial046:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-21_00:21:18-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/62184/remote/trial046 2026-02-21T01:35:41.252 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-21T01:35:41.299 INFO:teuthology.task.internal:Removing archive directory... 2026-02-21T01:35:41.299 DEBUG:teuthology.orchestra.run.trial043:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-21T01:35:41.302 DEBUG:teuthology.orchestra.run.trial046:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-21T01:35:41.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-21T01:35:41.348 INFO:teuthology.task.internal:Not uploading archives. 2026-02-21T01:35:41.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-21T01:35:41.360 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-21T01:35:41.361 DEBUG:teuthology.orchestra.run.trial043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-21T01:35:41.362 DEBUG:teuthology.orchestra.run.trial046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-21T01:35:41.376 INFO:teuthology.orchestra.run.trial043.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 01:35 /home/ubuntu/cephtest 2026-02-21T01:35:41.390 INFO:teuthology.orchestra.run.trial046.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 01:35 /home/ubuntu/cephtest 2026-02-21T01:35:41.391 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-21T01:35:41.409 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-21T01:35:41.445 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{bitmap} base mem$/{normal-1} onode-segment$/{none} write$/{v1/{compr$/{no$/{no}} v1}}}} rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/rados_api_tests} duration: 731.4410071372986 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-21T01:35:41.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T01:35:41.552 INFO:teuthology.run:pass